-- Logs begin at Tue 2022-09-13 19:14:29 UTC, end at Tue 2022-09-13 20:12:31 UTC. -- Sep 13 19:43:04.175371 dv-cinder-854274-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 19:43:04.186575 dv-cinder-854274-5-smb devstack@keystone.service[81551]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:43:04 2022] *** Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: nodename: dv-cinder-854274-5-smb Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: machine: x86_64 Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: clock source: unix Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: pcre jit disabled Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: detected number of CPU cores: 4 Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: current working directory: / Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: your processes number limit is 47680 Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: your memory page size is 4096 bytes Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: detected max file descriptor number: 2048 Sep 13 19:43:04.188650 dv-cinder-854274-5-smb devstack@keystone.service[81551]: lock engine: pthread robust mutexes Sep 13 19:43:04.189553 dv-cinder-854274-5-smb devstack@keystone.service[81551]: thunder lock: enabled Sep 13 19:43:04.189553 dv-cinder-854274-5-smb devstack@keystone.service[81551]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 19:43:04.189553 dv-cinder-854274-5-smb devstack@keystone.service[81551]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:43:04.230904 dv-cinder-854274-5-smb devstack@keystone.service[81551]: Python main interpreter initialized at 0x55ad69dc29c0 Sep 13 19:43:04.230904 dv-cinder-854274-5-smb devstack@keystone.service[81551]: python threads support enabled Sep 13 19:43:04.230904 dv-cinder-854274-5-smb devstack@keystone.service[81551]: your server socket listen backlog is limited to 100 connections Sep 13 19:43:04.230904 dv-cinder-854274-5-smb devstack@keystone.service[81551]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:43:04.231251 dv-cinder-854274-5-smb devstack@keystone.service[81551]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:43:04.231333 dv-cinder-854274-5-smb devstack@keystone.service[81551]: *** Operational MODE: preforking *** Sep 13 19:43:04.231587 dv-cinder-854274-5-smb devstack@keystone.service[81551]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:43:04.231587 dv-cinder-854274-5-smb devstack@keystone.service[81551]: spawned uWSGI master process (pid: 81551) Sep 13 19:43:04.231870 dv-cinder-854274-5-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 19:43:04.232588 dv-cinder-854274-5-smb devstack@keystone.service[81551]: spawned uWSGI worker 1 (pid: 81563, cores: 1) Sep 13 19:43:04.232706 dv-cinder-854274-5-smb devstack@keystone.service[81551]: spawned uWSGI worker 2 (pid: 81564, cores: 1) Sep 13 19:43:04.232874 dv-cinder-854274-5-smb devstack@keystone.service[81551]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:43:08.449409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:43:08.449409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: from cryptography.utils import int_from_bytes Sep 13 19:43:08.450105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:43:08.450105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: from cryptography.utils import int_from_bytes Sep 13 19:43:08.450542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:43:08.450542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: from cryptography.utils import int_from_bytes Sep 13 19:43:08.450651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:43:08.450651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: from cryptography.utils import int_from_bytes Sep 13 19:43:08.499114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:43:08.499319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:43:08.499526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] command line args: [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:43:08.499622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:43:08.499694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:43:08.499759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:43:08.499827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] command line args: [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:43:08.499886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ================================================================================ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:43:08.500074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:43:08.500160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] admin_token = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.500295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ================================================================================ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:43:08.500383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_dir = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.500511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.500594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] admin_token = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.500777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] config_source = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.500873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config_dir = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.500979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] debug = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] config_source = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] debug = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.501968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_config_append = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.502876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_dir = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_config_append = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_dir = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.503919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.504752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.505935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.506985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507115 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] publish_errors = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.507937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.510646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.510646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] publish_errors = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.511105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.511105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.511934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.512315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.512561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.512561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.513019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.513226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.513505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] standard_threads = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.513724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.514324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.514528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] standard_threads = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.514716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.514716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.515143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.515337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_journal = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.515523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.515768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_json = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.515920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.516280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_stderr = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.516663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_journal = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.516931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] use_syslog = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.517080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_json = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.517334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.517495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_stderr = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.517495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] use_syslog = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.518101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.518380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:43:08.518547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.518690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.518826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.518972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.519540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.519752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.519990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.519990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.520434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.520713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.520906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.521455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.521623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.521760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.521896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.522954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.523873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.524016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.524156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.524284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.524417 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.524544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.524775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.525074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.525513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.526987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.527999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.528426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.528599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.528911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.529157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.529381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.529605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.530117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.530362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.530590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.530791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.530958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.531186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.531369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.532246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.532447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.532602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.533031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.533509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.534213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.534466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.534730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.535044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.535356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.535488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.535615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.535751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.535878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.536884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.537950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.538247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.538562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.538750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.538832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.538893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.539993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.540948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.541966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.542987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.543982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.544905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.545984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.546974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.547954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.548958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.external = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.password = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.external = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] auth.token = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.549893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.password = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] auth.token = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.550930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.551949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.552951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553472 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.553986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.554937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.555964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.556952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557628 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.557922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.558957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559610 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.559949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.560946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.561929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.562955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.563929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.564976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.565929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.566959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.567987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.568975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.569992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570141 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.570952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.571971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.572933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.573938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.574972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.575981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576894 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.576966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.577951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.578895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.579981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.580923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.581738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81564) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:43:08.581842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.582083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.582315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.582559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.582791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.583031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.583258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.583495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.583725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:43:08.583892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81563) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:43:08.611239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.611465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.611688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.612341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.612581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.612831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.619941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.621146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.647634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.647913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.648825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.649061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.700022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.700356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.747913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.748101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.748645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.748893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.909392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.909689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.909830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.909917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.910745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.933334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.933536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.933665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.933765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.933847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.933990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.934797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.945684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.946031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.958353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.958486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.958570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.958699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.958789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.958918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81564) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959628 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.959827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81563) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:43:08.976131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.976335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:43:08.976431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.976600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:43:08.976715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.976903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:43:08.976990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.977128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:43:08.977251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.977374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.977507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.977671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.977796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.977921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.978050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.978175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.987773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.987991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.988119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.988236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.988325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.988542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.988688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.988822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.995495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:08.995800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:08.998418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:08.998702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.998827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:08.998998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:08.999970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.000952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.001082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.001215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.001337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.023475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.023837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.024951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.025240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.025366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.025586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.029912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.030190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.030314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.030463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.030609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.030851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.036702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.036983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.037107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.037397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.042513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.042798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.043195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.043925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.044062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.044149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.044360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.044495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.044653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.044942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.059710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.060001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.060290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.060569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.063874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.064347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.067068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.067360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.067554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.067843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.071545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.072000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.074716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.075147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.077926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.078221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.078404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.078797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.079104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.079842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.079988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.080119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.080259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.080387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.080516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.080516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.095009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.095298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.095553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.095680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.095908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.096011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.096250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.096341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.102547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.103122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.104061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.104708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.105675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.105952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.106191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.106461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.108957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.109245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.109529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.109653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.109851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.110037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.110037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.110246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.110342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.110727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.121171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.121454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.121730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.121856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.122009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.122197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.122427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.122522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.122651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.122776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.122957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.123074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.123324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.123604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.138239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.138929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.141142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.141867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.143990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.144748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.145439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.146183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.146882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.147170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.147574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.147699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.147884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.148310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.153961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.154699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.155387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.156138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.158262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.158654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.158942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.159065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.159226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.159424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.159737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.160014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.166946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.167217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.167516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.167772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.168063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.168356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.175227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81564) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.175508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.175783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.176060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.176329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.176595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.176836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81563) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:43:09.176955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.177956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81564) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.178940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.179210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.179495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.179770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.180042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.180314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.180591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81563) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:43:09.216210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad69dc29c0 pid: 81564 (default app) Sep 13 19:43:09.217816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ad69dc29c0 pid: 81563 (default app) Sep 13 19:43:09.219910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde793cd-e074-494f-a705-fce12c95d142 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.220191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde793cd-e074-494f-a705-fce12c95d142 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.220459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde793cd-e074-494f-a705-fce12c95d142 None None] PATH_INFO: `/v3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.224592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Tue Sep 13 19:43:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:16.088257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.088852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.088852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.093181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:16.100577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.101448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.101618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.174721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: INFO dbcounter [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] Registered counter for database keystone Sep 13 19:43:16.195896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG oslo_db.sqlalchemy.engines [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81564) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:43:16.206082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writer thread running {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:43:16.385204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG passlib.handlers.bcrypt [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81564) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:43:16.385495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG passlib.handlers.bcrypt [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81564) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:43:16.444354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:16.445985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:16.579120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 19:43:17.091305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.167062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: INFO dbcounter [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] Registered counter for database keystone Sep 13 19:43:17.192067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG oslo_db.sqlalchemy.engines [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81563) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:43:17.203574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writer thread running {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:43:17.324822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83183586-9133-47c0-9f16-ba224d4f6747 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.330254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.330891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.331177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.331446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.340654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.392486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:43:17.392804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c11072-9422-4670-93fa-33a9555454d2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.402729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:43:17.412677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.438737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86299f0f-fbcf-418a-a663-f6c9bff26f1b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.444531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.445709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.445993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.446271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] PATH_INFO: `/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.447997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] RBAC: Authorizing `identity:get_project(project_id=23d0b7aaf7cd4805b724aaf6b19401b4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.501158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING keystone.common.rbac_enforcer.enforcer [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:43:17.501481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d6e4b-2a83-409c-a1f5-719725c17c09 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.506073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4 => generated 344 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.628171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47443-61d0-466b-abcc-9ed62f48aa99 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.629167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47443-61d0-466b-abcc-9ed62f48aa99 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.629167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d47443-61d0-466b-abcc-9ed62f48aa99 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.635816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:19.644058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.644518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.644628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.666695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:19.668193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:19.676643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 19:43:19.941459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47443-61d0-466b-abcc-9ed62f48aa99 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.961083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d47443-61d0-466b-abcc-9ed62f48aa99 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.967154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9e597-7908-4291-9b02-e86d448b1d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.967767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9e597-7908-4291-9b02-e86d448b1d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.968070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9e597-7908-4291-9b02-e86d448b1d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.968351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9e597-7908-4291-9b02-e86d448b1d16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.977040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9e597-7908-4291-9b02-e86d448b1d16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.978826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9e597-7908-4291-9b02-e86d448b1d16 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.988683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:43:19.996662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:20.011454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c5250-830e-4895-86cd-72e6633647c7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:20.018578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f8d7f-4c07-4de6-a25b-ab387441e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:20.019217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f8d7f-4c07-4de6-a25b-ab387441e185 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.019495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f8d7f-4c07-4de6-a25b-ab387441e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.019762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f8d7f-4c07-4de6-a25b-ab387441e185 admin admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.021259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f8d7f-4c07-4de6-a25b-ab387441e185 admin admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:20.023079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f8d7f-4c07-4de6-a25b-ab387441e185 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:20.024638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:22.233853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1383413-551d-4eb1-ba8a-3c4699f75c22 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.234786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1383413-551d-4eb1-ba8a-3c4699f75c22 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.234786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1383413-551d-4eb1-ba8a-3c4699f75c22 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.236061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:22.241468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.241924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.242019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.260896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:22.262079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:22.265431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395299b-d98c-4d29-a702-ca4be73b7dce None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.265716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395299b-d98c-4d29-a702-ca4be73b7dce None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.265993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395299b-d98c-4d29-a702-ca4be73b7dce None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.267354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:22.272400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.272711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.272983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.314858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG passlib.handlers.bcrypt [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81563) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:43:22.315235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG passlib.handlers.bcrypt [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81563) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:43:22.347195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:22.364188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:22.365851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:22.466931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:22.612583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.638707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.720985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7367d-5267-46e3-a8ab-3c911bd424bc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.724855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.757230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.757875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.758155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.758456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.769972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:22.778844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:22.780059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:22.781135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:22.785880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.828111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dd3fe-8790-43a5-bc0e-af936903aa17 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.830471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.866071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.866681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.867656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.867942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.868344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.884700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3378c5-465c-4012-ba3a-91d03bc7d39e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.919053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.919903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.920184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.920460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.921170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:22.921511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.922918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.934418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:22.934562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.936033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.943097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.035050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:23.040869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.041284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b0fe-e2b4-41b3-b99a-734bbe35ce8b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.043550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.075539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.076176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.076455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.076822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.077989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.079451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.081065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:23.086530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.101466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.137561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e65f-b239-4f20-ade8-01d1e051b713 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.170971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.171946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.172228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.172501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.183539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33a74d-878a-4372-9572-a9d557aad9ec None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.190911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.192427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:23.211432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:23.212340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:23.213511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:23.213511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:23.213511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:23.213511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:23.218379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.219516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.220153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.220430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.220740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.221854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.223294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.225020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:23.230465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.275101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.311492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.319608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d4cb4-cf3b-4937-bf22-b1fcebd06d12 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.330457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ef15-22b8-45d2-a521-12ee06d309aa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.351937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.352556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.352864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.353144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.353792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:23.354096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.355479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c67806-bd26-478e-b68b-2965a9ec59eb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.363333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.363939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.364216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.364486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.365227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.domain.id=default, user.id=bee6ddf3af8f44e6a826bfe586fc1067) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:23.365530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.366942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e755bd-f51c-45b3-bbce-33193ab4352a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.372804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:23.373341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/role_assignments?user.id=bee6ddf3af8f44e6a826bfe586fc1067&scope.domain.id=default&role.id=ff6687245616423c8a3e42542a544932 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:25.949454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada681-fa55-4c2f-bfbb-b8e1630c0df8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.949984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada681-fa55-4c2f-bfbb-b8e1630c0df8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.949984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada681-fa55-4c2f-bfbb-b8e1630c0df8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.951615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:25.957426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1be95-c71c-440e-a3b7-672fc2649215 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.957894 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1be95-c71c-440e-a3b7-672fc2649215 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.957968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1be95-c71c-440e-a3b7-672fc2649215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.985679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-67a1be95-c71c-440e-a3b7-672fc2649215 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:25.986907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-67a1be95-c71c-440e-a3b7-672fc2649215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:26.039605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854efa-7d10-42c2-bdca-22322d5f797a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.039935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854efa-7d10-42c2-bdca-22322d5f797a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.040148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06854efa-7d10-42c2-bdca-22322d5f797a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.041529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 12/23] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:26.050240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbeb6-d1dc-436d-8673-585c2cd00f0b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.050808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbeb6-d1dc-436d-8673-585c2cd00f0b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.051297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbeb6-d1dc-436d-8673-585c2cd00f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.085613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-10ddbeb6-d1dc-436d-8673-585c2cd00f0b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:26.087172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-10ddbeb6-d1dc-436d-8673-585c2cd00f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:26.094287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 12/24] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:26.205721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 13/25] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:26.231558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2a1e9-bb2b-420d-a6c5-adead1fb30cf None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.231842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2a1e9-bb2b-420d-a6c5-adead1fb30cf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.232271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2a1e9-bb2b-420d-a6c5-adead1fb30cf None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.233850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 13/26] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:26.239595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.240074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.240488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.265979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:26.267444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:26.277316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bbc32-ed86-497c-b58c-d50efd90943b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.277884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bbc32-ed86-497c-b58c-d50efd90943b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.278293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bbc32-ed86-497c-b58c-d50efd90943b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.279820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 14/27] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:26.290129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.290627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.291035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.318042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:26.320157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:26.366470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.414878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 14/28] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:26.423900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 15/29] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:26.447883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.583325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.590480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.592680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd113b-690e-4d5c-ab0c-6bd18b527803 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.636238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.636909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.637187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.637455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.651150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.652656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:43:26.679003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:26.679903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:43:26.681167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:43:26.681167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:43:26.681167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:26.681167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 15/30] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:26.685832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.735051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.790153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42756d92-b9c3-405b-86c4-dce8cb56fa53 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.828984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.829682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.829968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.830238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.840710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:26.846084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:26.846983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:26.847710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 16/31] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:26.848925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.856513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cab23-e39e-46b0-8165-69087251ed0e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.892393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.893343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.893839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.894377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.895214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:26.895725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.897375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.909693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 16/32] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:26.910701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.915334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.959033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33db8b-68df-423d-8156-b41c3fe36f00 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.997525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.998873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.999762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.000233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.001313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.003572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.009719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:27.025934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbefa1-4cc2-418a-a196-df014478d1f7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.063397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.064295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.064830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.065264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.066076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.067639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.140002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 17/33] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Sep 13 19:43:26 2022] POST /identity/v3/roles => generated 219 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:27.141130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.212890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 17/34] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Sep 13 19:43:26 2022] POST /identity/v3/roles => generated 225 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:27.214466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.278927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3ff12-c734-48a2-804e-617a014c08a2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.330530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:27.355248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8a0ea-ca23-498f-bfd9-bb146740b7c3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.356068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.356815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.357162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.357502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.358371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:27.358770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.360923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.380836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 18/35] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:27.386909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.407020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.407665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.407950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.408225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.409227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.411165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.461911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:27.473752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 18/36] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:43:27 2022] POST /identity/v3/projects => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:27.543537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491ac53-5b71-408e-a8bf-acd58efa3a71 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.587214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.588033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.588317 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.588673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.590107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.591766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.593687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 19/37] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:27 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:27.599657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.717979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51bfe-63ac-445e-b09b-3390bc4709e3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.758774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5666a24-fe55-4684-8aec-2b313a6ad024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.759510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5666a24-fe55-4684-8aec-2b313a6ad024 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.759792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5666a24-fe55-4684-8aec-2b313a6ad024 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.760114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5666a24-fe55-4684-8aec-2b313a6ad024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.761577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5666a24-fe55-4684-8aec-2b313a6ad024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.763086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5666a24-fe55-4684-8aec-2b313a6ad024 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.764893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 19/38] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:27.771238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.834425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:27.883514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021c966-b3f6-4b9b-bc92-2398a48d8870 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.883842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e77e-0b43-4b09-ad1a-79eaa037dfbc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.884037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e77e-0b43-4b09-ad1a-79eaa037dfbc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.884314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e77e-0b43-4b09-ad1a-79eaa037dfbc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.885892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 20/39] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:27.891061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.891386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.891612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.914451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:27.916385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:27.925871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416e32d-c232-4040-b13c-0038a3fd5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.926545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416e32d-c232-4040-b13c-0038a3fd5689 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.926804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416e32d-c232-4040-b13c-0038a3fd5689 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.927272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416e32d-c232-4040-b13c-0038a3fd5689 None admin] PATH_INFO: `/v3/domains/default/users/bee6ddf3af8f44e6a826bfe586fc1067/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.929209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416e32d-c232-4040-b13c-0038a3fd5689 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bee6ddf3af8f44e6a826bfe586fc1067, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.930663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416e32d-c232-4040-b13c-0038a3fd5689 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.948671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 20/40] 10.222.0.65 () {58 vars in 1361 bytes} [Tue Sep 13 19:43:27 2022] PUT /identity/v3/domains/default/users/bee6ddf3af8f44e6a826bfe586fc1067/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:27.959589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c71a-35fc-44c6-a9ea-c20a33a605a7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.960691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c71a-35fc-44c6-a9ea-c20a33a605a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.961057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c71a-35fc-44c6-a9ea-c20a33a605a7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.962585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 21/41] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:27.969391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.969629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.969852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.989896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:27.991491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:27.995312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.001842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 21/42] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:28.071513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 22/43] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:28.262523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.341676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.364763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4802a-70ab-45ce-a72d-4ae07c9ab9e3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:28.406172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:28.407098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.407525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.407980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.409384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:28.411048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:28.413338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 22/44] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:28.418939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.496187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.502746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.533274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857fcb7-d606-4456-a3a7-072cd8ec7954 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:28.567370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a03af-42b6-40fa-8454-8b2d7e29d4bb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:28.571395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff690fff-6bd8-4ac4-855d-79a1b1cb3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:28.572009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff690fff-6bd8-4ac4-855d-79a1b1cb3737 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.572287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff690fff-6bd8-4ac4-855d-79a1b1cb3737 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.572557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff690fff-6bd8-4ac4-855d-79a1b1cb3737 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.573245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff690fff-6bd8-4ac4-855d-79a1b1cb3737 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:28.575122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff690fff-6bd8-4ac4-855d-79a1b1cb3737 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:28.603677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c01da-af84-4b74-b03e-dc529bc570e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:28.603888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:43:28 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:28.604994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c01da-af84-4b74-b03e-dc529bc570e6 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.605461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c01da-af84-4b74-b03e-dc529bc570e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.605865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c01da-af84-4b74-b03e-dc529bc570e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.606680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c01da-af84-4b74-b03e-dc529bc570e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:28.608356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c01da-af84-4b74-b03e-dc529bc570e6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:28.626509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Sep 13 19:43:28 2022] POST /identity/v3/roles => generated 223 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:43:30.088507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d032f02-e797-4005-afd8-46abcf2374c5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.089132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d032f02-e797-4005-afd8-46abcf2374c5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.089132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d032f02-e797-4005-afd8-46abcf2374c5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.090399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:30.096042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.096435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.096657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.115977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:30.117183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:30.185144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:30.445619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d032f02-e797-4005-afd8-46abcf2374c5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.661978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d032f02-e797-4005-afd8-46abcf2374c5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.681715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.700023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa80ab-abec-43cc-b23e-2e32d56968f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.700606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa80ab-abec-43cc-b23e-2e32d56968f5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.700905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa80ab-abec-43cc-b23e-2e32d56968f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.701178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa80ab-abec-43cc-b23e-2e32d56968f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.712392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa80ab-abec-43cc-b23e-2e32d56968f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-59aa80ab-abec-43cc-b23e-2e32d56968f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:30.718707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:30.719558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:30.720301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:30.725900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.759883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.768538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ee7eb-86cf-434c-ac2c-d06ae0943f12 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.768855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ee7eb-86cf-434c-ac2c-d06ae0943f12 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.769133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ee7eb-86cf-434c-ac2c-d06ae0943f12 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.770500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 26/50] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:30.775467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.775752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.776023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.794282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:30.795469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:30.826748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e59b7a-0620-4aaa-bf93-53216814f52a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.860963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.861575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.861857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.862365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.862474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 27/51] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:30.862791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:30.863093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.864521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.872632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 25/52] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:30.878345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.977781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef8a99-f0eb-4706-81af-15dd2a885a77 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.987903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.014033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.014678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.015002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.015250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.016668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.018107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.019855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 28/53] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.025351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.122068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.128452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c071f-a0e3-4719-b98b-b1d454400a7d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.130708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.163453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.164100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.164362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.164659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.165773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.167205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.168812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 26/54] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.174541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.228226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1e2f9-0a59-49af-bf50-8bfd04cc59bd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.262403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.263053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.263331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.263604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.264757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.266890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.269139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 29/55] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.270801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058484-e5a3-40bb-92d0-d65e8309f54a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.274648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.304735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.305374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.305634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.305893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.306627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.domain.id=default, user.id=bee6ddf3af8f44e6a826bfe586fc1067) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:31.306935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.308393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f5c16-416d-4443-a0c3-8eb420729e07 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.314060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 27/56] 10.222.0.65 () {56 vars in 1322 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/role_assignments?user.id=bee6ddf3af8f44e6a826bfe586fc1067&scope.domain.id=default&role.id=ff6687245616423c8a3e42542a544932 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:31.320969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.384758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bacf7-3bea-4154-8c6a-af8666b4484c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.423012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca1420-bc9f-47a3-8a1b-0eda977f362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.423649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca1420-bc9f-47a3-8a1b-0eda977f362a None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.423934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca1420-bc9f-47a3-8a1b-0eda977f362a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.424187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca1420-bc9f-47a3-8a1b-0eda977f362a None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.424910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca1420-bc9f-47a3-8a1b-0eda977f362a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.426381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca1420-bc9f-47a3-8a1b-0eda977f362a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.456842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 30/57] 10.222.0.65 () {60 vars in 1140 bytes} [Tue Sep 13 19:43:31 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:43:33.637948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373890b6-cdf9-4220-a0a3-04dd5b3d343f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.638507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373890b6-cdf9-4220-a0a3-04dd5b3d343f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.638507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373890b6-cdf9-4220-a0a3-04dd5b3d343f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.639875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 28/58] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:33.647432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.648106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.648315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.675534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:33.676775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:33.746847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 31/59] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:34.016511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373890b6-cdf9-4220-a0a3-04dd5b3d343f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.047813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:34.144005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373890b6-cdf9-4220-a0a3-04dd5b3d343f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.178551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4150016-383a-489c-8bf0-534cb2d87f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.179184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150016-383a-489c-8bf0-534cb2d87f21 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.179467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150016-383a-489c-8bf0-534cb2d87f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.179739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150016-383a-489c-8bf0-534cb2d87f21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.181013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4150016-383a-489c-8bf0-534cb2d87f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.182482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4150016-383a-489c-8bf0-534cb2d87f21 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.184037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 29/60] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:34.190043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.217401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:34.292532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb1482-5e38-4dd3-a762-f82d26eb716c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.327195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978707b-271b-47d5-8f61-59b23d3a74c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.327849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978707b-271b-47d5-8f61-59b23d3a74c6 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.328132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978707b-271b-47d5-8f61-59b23d3a74c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.328396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978707b-271b-47d5-8f61-59b23d3a74c6 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.329087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978707b-271b-47d5-8f61-59b23d3a74c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.330518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978707b-271b-47d5-8f61-59b23d3a74c6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.358061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 32/61] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:34 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:37.657873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8de0-022f-4666-aca6-33d0ef38e587 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.658902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8de0-022f-4666-aca6-33d0ef38e587 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.659407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8de0-022f-4666-aca6-33d0ef38e587 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.661009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 30/62] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:37.666658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf4162-768e-4550-9563-35c904707c44 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.667492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf4162-768e-4550-9563-35c904707c44 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.667978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf4162-768e-4550-9563-35c904707c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.694032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c6bf4162-768e-4550-9563-35c904707c44 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:37.695546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c6bf4162-768e-4550-9563-35c904707c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:37.728843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969a8a-8121-48f0-bce7-b2bf35349b95 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.729466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969a8a-8121-48f0-bce7-b2bf35349b95 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.729929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969a8a-8121-48f0-bce7-b2bf35349b95 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.731462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:37.737897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d074ff-c864-43a2-b3e2-da2b2443665e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.738408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d074ff-c864-43a2-b3e2-da2b2443665e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.738910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d074ff-c864-43a2-b3e2-da2b2443665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.766045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-57d074ff-c864-43a2-b3e2-da2b2443665e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:37.770083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-57d074ff-c864-43a2-b3e2-da2b2443665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:37.827739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 33/64] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:37.892368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 32/65] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 13 19:43:37.987238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea426ad-6238-4039-ad9e-dd92781c5231 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.987531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea426ad-6238-4039-ad9e-dd92781c5231 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.987709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea426ad-6238-4039-ad9e-dd92781c5231 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.989126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 34/66] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:37.994425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.994714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.994987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.016785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:38.017965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:38.049775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.125467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 33/67] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:38.152385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea426ad-6238-4039-ad9e-dd92781c5231 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.174682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.180134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.310352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea426ad-6238-4039-ad9e-dd92781c5231 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.318817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f437019-0e38-410f-a042-47cf5dd17970 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.350647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.351255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.351536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.351804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.353204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f462f6-c43e-4d8c-a242-180f5a7fcc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.353847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f462f6-c43e-4d8c-a242-180f5a7fcc1c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.354130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f462f6-c43e-4d8c-a242-180f5a7fcc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.354408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f462f6-c43e-4d8c-a242-180f5a7fcc1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.363012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:38.364604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f462f6-c43e-4d8c-a242-180f5a7fcc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:38.368359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:38.369327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:38.370084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-97f462f6-c43e-4d8c-a242-180f5a7fcc1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:38.370649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:38.371401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:38.372140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 34/68] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:38.372799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84677-ab6b-4034-ab36-ccc40581abe9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.372799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84677-ab6b-4034-ab36-ccc40581abe9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.372799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84677-ab6b-4034-ab36-ccc40581abe9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.373962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 35/69] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:38.378620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749c90c-1d44-4f04-8d04-8223fe6d27b4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.378620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749c90c-1d44-4f04-8d04-8223fe6d27b4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.378620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749c90c-1d44-4f04-8d04-8223fe6d27b4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.379070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 35/70] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:38.379210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 36/71] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:38.379414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.384240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9040-2015-41fc-bc21-8ddc18ef4399 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.384525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9040-2015-41fc-bc21-8ddc18ef4399 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.384827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c9040-2015-41fc-bc21-8ddc18ef4399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.402807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bd6c9040-2015-41fc-bc21-8ddc18ef4399 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:38.403999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd6c9040-2015-41fc-bc21-8ddc18ef4399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:38.415345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.464455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.475172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 37/72] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:38.476388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3688-9475-476b-b709-74479b3b748e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.476723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3688-9475-476b-b709-74479b3b748e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.476994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc3688-9475-476b-b709-74479b3b748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.494975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b8a66-2090-4b8b-a4ce-43bf7b161b8f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.497049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-85cc3688-9475-476b-b709-74479b3b748e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:38.498238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85cc3688-9475-476b-b709-74479b3b748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:38.530527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.531264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.531549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.531823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.532490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:38.532842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.534233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.546026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.546634 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.570156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 38/74] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:38.570926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3688-9475-476b-b709-74479b3b748e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.648136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.677057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc3688-9475-476b-b709-74479b3b748e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.678572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2bc04-8123-47fa-affb-e32d55dde60a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.714399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.714960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.715243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.715518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.716195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:38.716505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.718057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.719395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.724539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.726414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.726892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.727355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.727787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.733351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.740873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:38.746950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:38.747803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:38.748545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:38.749172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 39/76] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:38.751791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.839110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffd7a-b8ad-4311-9bb0-dd04d7bf8da1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.849590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08831fcf-f4d5-4cf2-a764-68a7034c061e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.872886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.873524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.873802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.874070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.875260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.876765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.878360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 38/77] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.879098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.887291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.887939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.888219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.888494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.891397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.902570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.904027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.905710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 40/78] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.906463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.939653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.976460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc8a7b-181a-4ca3-93d1-cd090e9da3dc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.005244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dfab4-5f22-41a8-a423-0ad0394c5d24 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.009662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.010308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.010588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.010866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.021148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:39.026360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:39.027243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:39.028015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 39/79] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:39.028652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.040209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.040852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.041131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.041404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.042070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:39.042405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.043749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.051941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 41/80] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.052740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.106402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.129952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a3995-c7f7-44a6-9baf-7197cb385279 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.152594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.157735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a2995-f955-4342-81d5-e0e9959d7102 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.164222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.165290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.165575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.165847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.166973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.168441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.170042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 40/81] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.170802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.193633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.194254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.194535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.194805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.261157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.262641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.268097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfef13b-e9d7-4f1f-b7dc-e4a9645d95ec None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.301022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.301641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.301922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.302193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.314807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.360277 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 42/82] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:39.360648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.361066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.370884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.372359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.458657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647ae50-4389-4a10-ab81-f2b19218f939 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.482861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 41/83] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:39.482861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.494934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.495556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.495834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.496102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.496795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:39.497090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.498479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.506478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 43/84] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.507447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.529282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.567163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.576489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45930f-16bc-4155-88a0-6777ab07b51f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.607774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c7b1b2-4d50-4499-a810-493c92c4d32b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.609222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.610212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.610554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.610767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.611916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.613409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.615001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 42/85] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.615756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.646047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.646667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.646952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.647230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.647885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.649378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.676816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 44/86] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:39 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:39.677621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.729320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6681b9-4b91-4177-9125-af96040189f1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.767152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.767959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.768249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.768528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.769935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.771441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.778673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 43/87] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.778673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.779652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.805977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.807171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ec85-c532-4dac-8e87-21bbdc1bc1f8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.855580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.856283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.856560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.858682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.858682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.860851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.862727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 45/88] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.863499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.883610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066fcaf-fe2b-4abd-a43f-619439554755 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.923585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.924598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.924598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.926679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.926679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.927850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.929489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 44/89] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.929989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.998802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edb439-96f9-4130-97a2-1b0a294eeab6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.041051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.041675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.041952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.042224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.052085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.058217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.059709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a8e94-2503-4e65-8cea-8c50edff44e9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.103048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.104295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.104813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.105277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.106200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=bee6ddf3af8f44e6a826bfe586fc1067) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:40.106726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.108474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.118480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 45/90] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/role_assignments?user.id=bee6ddf3af8f44e6a826bfe586fc1067&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:40.119559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.126676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.128351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.257288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce4d06-f6e1-4ad4-996f-0e9c25d2bedb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.298231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.299017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.299358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.299695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.300507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=f5c4cf6a8a96407ca6d6755ef729b676) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:40.300914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.303176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.309954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 46/91] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/role_assignments?user.id=f5c4cf6a8a96407ca6d6755ef729b676&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=179c8295939541c3816444f2b7a59ae4 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:40.310913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.311665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 46/92] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:40.321797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.340794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.400932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.511004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc035208-a764-4ce3-b2ec-214481d1b7f5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.558585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5accf-d892-46f7-9013-afe2c053a60f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.594814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.595450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.595735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.596008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.630178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.630823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.631104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.631371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.632486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.633969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.640973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 47/93] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:40.646530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.737848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.739372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.789706 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.842081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b688f-afc7-450f-9414-b1c71e6ea967 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.861248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.892991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.894813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.895297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.895758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.896748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] RBAC: Adding query filter params (role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=f5c4cf6a8a96407ca6d6755ef729b676) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:40.897408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.899614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.908378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 48/94] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/role_assignments?user.id=f5c4cf6a8a96407ca6d6755ef729b676&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:40.957754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 47/95] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:40.963810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.117364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8716c-c673-45e1-8932-05b48f4deb24 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.159664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029fd5b-bd81-42e4-a97d-8d40185146fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.160315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029fd5b-bd81-42e4-a97d-8d40185146fb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.160593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029fd5b-bd81-42e4-a97d-8d40185146fb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.160884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029fd5b-bd81-42e4-a97d-8d40185146fb None admin] PATH_INFO: `/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.162018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029fd5b-bd81-42e4-a97d-8d40185146fb None admin] RBAC: Authorizing `identity:get_project(project_id=607a002f6e7e43ff96644d4fc8c6f5d1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.163478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029fd5b-bd81-42e4-a97d-8d40185146fb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.165434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 49/96] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:41.171245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.326492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd447e2b-dbd1-42c3-84f0-d32f16051369 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.356487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.368966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.369516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.369800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.370075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.370815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=607a002f6e7e43ff96644d4fc8c6f5d1, user.id=f5c4cf6a8a96407ca6d6755ef729b676) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:41.371126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.372587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c88801-2064-4a76-a247-d1ee179e0ec9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.380536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 48/97] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/role_assignments?user.id=f5c4cf6a8a96407ca6d6755ef729b676&scope.project.id=607a002f6e7e43ff96644d4fc8c6f5d1&role.id=179c8295939541c3816444f2b7a59ae4 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:42.703358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69385ec5-bb63-47e1-a6d5-82f3391e1da8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:42.703847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69385ec5-bb63-47e1-a6d5-82f3391e1da8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:42.703847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69385ec5-bb63-47e1-a6d5-82f3391e1da8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:42.705263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 50/98] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:42.710554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2ef86-ca7c-42d8-b216-65cedc442764 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:42.710963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2ef86-ca7c-42d8-b216-65cedc442764 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:42.711142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2ef86-ca7c-42d8-b216-65cedc442764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:42.741807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-77d2ef86-ca7c-42d8-b216-65cedc442764 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:42.743047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-77d2ef86-ca7c-42d8-b216-65cedc442764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:42.824371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 49/99] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:42.836507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acedfd-c8bd-4d3c-9adc-9b4ee4bdb885 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:42.836813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acedfd-c8bd-4d3c-9adc-9b4ee4bdb885 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:42.837091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acedfd-c8bd-4d3c-9adc-9b4ee4bdb885 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:42.838536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 51/100] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:42.845491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:42.845797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:42.846072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:42.873934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:42.875242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:42.962514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 50/101] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:43.297793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acedfd-c8bd-4d3c-9adc-9b4ee4bdb885 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:43.350117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:43.431791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acedfd-c8bd-4d3c-9adc-9b4ee4bdb885 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:43.478525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:43.479173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.479449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.479719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.490505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:43.495470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:43.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:43.497214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 52/102] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:43.502784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:43.514874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:43.626946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:43.705876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015de9ef-346c-41c4-b4ac-397451a0d437 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:43.708373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:43.722327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292f655-9c9f-4462-87f6-ee12c48e54b4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:43.774165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c54a-b3f1-4646-81ee-c6169b47eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:43.774809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c54a-b3f1-4646-81ee-c6169b47eca5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.775089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c54a-b3f1-4646-81ee-c6169b47eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.775358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c54a-b3f1-4646-81ee-c6169b47eca5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.777110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c54a-b3f1-4646-81ee-c6169b47eca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:43.778586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c54a-b3f1-4646-81ee-c6169b47eca5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:43.780192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 53/103] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:43.781499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe9478-263c-4b1e-a9b1-923eb6ac7026 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.781771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe9478-263c-4b1e-a9b1-923eb6ac7026 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.782047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe9478-263c-4b1e-a9b1-923eb6ac7026 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.783242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 54/104] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:43.788710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe9478-263c-4b1e-a9b1-923eb6ac7026 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:43.795432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:43.795992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.796280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.796637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.797351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:43.797657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:43.799048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be31086-9103-4bfc-b5c4-bdced1192973 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:43.811621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 51/105] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:43.814908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7496045-68c0-4a42-82df-8d9d52bbb34c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.815190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7496045-68c0-4a42-82df-8d9d52bbb34c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.815472 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7496045-68c0-4a42-82df-8d9d52bbb34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.840595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e7496045-68c0-4a42-82df-8d9d52bbb34c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:43.841824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e7496045-68c0-4a42-82df-8d9d52bbb34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:43.930861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe9478-263c-4b1e-a9b1-923eb6ac7026 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:43.932925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 52/106] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:43.934086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df1ae5-0591-46b5-82db-caa24e493952 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.934370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df1ae5-0591-46b5-82db-caa24e493952 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.934641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df1ae5-0591-46b5-82db-caa24e493952 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.936109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 53/107] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:43.937702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df1ae5-0591-46b5-82db-caa24e493952 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:43.975163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa46b18-d643-4faa-af93-4004f2df1eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:43.975804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46b18-d643-4faa-af93-4004f2df1eda None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.976105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46b18-d643-4faa-af93-4004f2df1eda None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.976383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46b18-d643-4faa-af93-4004f2df1eda None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.977074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa46b18-d643-4faa-af93-4004f2df1eda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:43.978666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa46b18-d643-4faa-af93-4004f2df1eda None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:43.987349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.019238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 55/108] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:43:43 2022] POST /identity/v3/projects => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:44.022003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a34ac-e794-4b8a-8f37-aaa13d962d48 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.022597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a34ac-e794-4b8a-8f37-aaa13d962d48 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.023081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a34ac-e794-4b8a-8f37-aaa13d962d48 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.029468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 56/109] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:44.031318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.031843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.032309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.054270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:44.056091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:44.062343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df1ae5-0591-46b5-82db-caa24e493952 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.077129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.099601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a947ea-eb4f-40bc-a1ec-ac262e4c052b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.100334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a947ea-eb4f-40bc-a1ec-ac262e4c052b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.100630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a947ea-eb4f-40bc-a1ec-ac262e4c052b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.100978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a947ea-eb4f-40bc-a1ec-ac262e4c052b None admin] PATH_INFO: `/v3/users/b52ce65dcbe9497c8bcbed8a82e5a75b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.120438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a947ea-eb4f-40bc-a1ec-ac262e4c052b None admin] RBAC: Authorizing `identity:get_user(user_id=b52ce65dcbe9497c8bcbed8a82e5a75b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.122067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a947ea-eb4f-40bc-a1ec-ac262e4c052b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.123880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 54/110] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:43 2022] GET /identity/v3/users/b52ce65dcbe9497c8bcbed8a82e5a75b => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:44.128643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.128643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.128643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.145530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:44.146948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:44.148072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 57/111] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:44.157424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.247597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 55/112] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:44.258773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.289224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.300826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b37d-d274-4b1f-a48c-ce4549b58aa7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.341375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.342339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.342933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.343496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.370723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.372069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2e4bd-ace2-4160-95dc-76391aaaebf0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.408733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.409446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.409766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.410038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.420444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:44.425020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:44.426188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:44.427002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:44.427756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 56/113] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:44.429565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.433179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.531893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.538450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 58/114] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:44.539529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.546104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf74de-3d23-4c92-9e4b-007c429c0647 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.586964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.587589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.587965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.588319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.589802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:44.591675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.593914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.601096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.605221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 57/115] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:44.607051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.652764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a91e30-18a7-4057-a6b8-b31de7967ac1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.688764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.690104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.690522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.690934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.702622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:44.708142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:44.709425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:44.710270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:44.712533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 59/116] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:44.713594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.717667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ddf8-176a-4640-933f-9181d31147f4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.753341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57c9a6-7332-46cf-b928-080021ab6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.753986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c9a6-7332-46cf-b928-080021ab6808 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.754245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c9a6-7332-46cf-b928-080021ab6808 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.754510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57c9a6-7332-46cf-b928-080021ab6808 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.755617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57c9a6-7332-46cf-b928-080021ab6808 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.757099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57c9a6-7332-46cf-b928-080021ab6808 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.758764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 58/117] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:44.760025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e88eae-0dad-4c11-aac0-1324020b5159 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.760307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e88eae-0dad-4c11-aac0-1324020b5159 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.760577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e88eae-0dad-4c11-aac0-1324020b5159 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.762469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 59/118] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:44.763809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e88eae-0dad-4c11-aac0-1324020b5159 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.783499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.829161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37eb3c-51e0-48f1-8c5e-0bccfbbb4e8c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.842573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.864535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.865207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.865490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.865768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.866906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.868367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.870228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 60/119] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:44.871823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e88eae-0dad-4c11-aac0-1324020b5159 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.873593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.908806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.909421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.909698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.909964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.910627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:44.910924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.912294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.920701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 60/120] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:44.921478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.986563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd1585-b905-4055-9e3d-857caac91ab3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.003463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.024823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a504a8-0d8b-4f5c-b434-feb90517b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.025246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ab247-51b4-4804-b33a-39c94ba7e4a7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.025503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a504a8-0d8b-4f5c-b434-feb90517b69d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.025789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a504a8-0d8b-4f5c-b434-feb90517b69d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.026065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a504a8-0d8b-4f5c-b434-feb90517b69d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.037515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a504a8-0d8b-4f5c-b434-feb90517b69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b9a504a8-0d8b-4f5c-b434-feb90517b69d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:45.042321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:45.043292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:45.044590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 61/121] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:45.049656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.049946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.050227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.063299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.063993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.064192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.064472 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.065234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] RBAC: Adding query filter params (role.id=e15766d617984ae3bbe12b81d0c1a1fe, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=b52ce65dcbe9497c8bcbed8a82e5a75b) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:45.065548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.066996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.068410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:45.069734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:45.072362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 61/122] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/role_assignments?user.id=b52ce65dcbe9497c8bcbed8a82e5a75b&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=e15766d617984ae3bbe12b81d0c1a1fe => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.073303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.122402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.162378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 62/123] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:45.163664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.195401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a9df8-6899-4e53-a752-017c341fa5fd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.239137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.240046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.240437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.240914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.242288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.244070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.245917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 62/124] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.246789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.265210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.276149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42a05d-44fe-4aed-9d6b-ae109989bd67 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.310889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.311361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.311700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.312007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.313304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.314811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.316405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 63/125] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.317249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.359112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.360092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00a694-a3d5-4e4d-9a7e-668043f8446e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.399208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.400219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.400770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.401240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.402200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:45.402849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.404499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.414235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 63/126] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.415468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.426746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f74ff8-cfb8-4a2b-b903-8292dbc01c82 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.478989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.479856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.479962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.480194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/f5c4cf6a8a96407ca6d6755ef729b676/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.482139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] RBAC: Authorizing `identity:create_grant(project_id=9887ccb4f90f4b25bc965506f3b262a0, user_id=f5c4cf6a8a96407ca6d6755ef729b676, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.483597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.498153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.520213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 64/127] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:45 2022] PUT /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/f5c4cf6a8a96407ca6d6755ef729b676/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:45.526076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27088-db90-408d-9ece-d5149caf9565 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.530366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.568223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.569274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.569751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.570219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.571779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.573574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.575738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 64/128] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.581700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.686771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.691072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3f4c6-2dc6-4942-843b-c7d4a5734d78 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.695097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbc004-f362-4fe5-a47a-f555bcabb519 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.727922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.728666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.728880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.729151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.730317 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.732216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.734429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 65/129] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.735105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.735668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.736236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.736739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.737200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/bee6ddf3af8f44e6a826bfe586fc1067/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.739490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9887ccb4f90f4b25bc965506f3b262a0, user_id=bee6ddf3af8f44e6a826bfe586fc1067, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.741382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.760088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 65/130] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:45 2022] PUT /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/bee6ddf3af8f44e6a826bfe586fc1067/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:45.761635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.765069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.887716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43af802-9721-4881-8c5a-ef490d2664b7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.899823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477b53b-2b7f-45c7-b674-cc9e8277dc92 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.927572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.928786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.929315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.929776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.931285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.933102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.934973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 66/131] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.940511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.941809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.943173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.945713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.946247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.971768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:45.982358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:45.983300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:45.984122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 66/132] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:45.989935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.039580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.053152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.076469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e1122-392e-44e9-a862-0910b9fba49b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.130903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.131585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.131869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.132142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/f5c4cf6a8a96407ca6d6755ef729b676/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.136723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] RBAC: Authorizing `identity:create_grant(project_id=9887ccb4f90f4b25bc965506f3b262a0, user_id=f5c4cf6a8a96407ca6d6755ef729b676, role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.138239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.168101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 67/133] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:45 2022] PUT /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/f5c4cf6a8a96407ca6d6755ef729b676/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:46.180143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33326ea9-bf07-47aa-8c6f-d69af0ef3790 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.226049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.226686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.226964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.227233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.227908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:46.228210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.229690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.239978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 67/134] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:46.245876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.390257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e1e2-bfe0-4219-9a04-141e16a9cc67 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.449460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.453401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.454079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.454449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.454724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.456062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.457591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.460701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 68/135] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.466105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.590139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.607923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cb769-2fa6-4d35-97d9-46e077afcab4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.647487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ddbcb-164f-4c27-b03f-fbfc02fa330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.648350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddbcb-164f-4c27-b03f-fbfc02fa330c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.648801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddbcb-164f-4c27-b03f-fbfc02fa330c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.649225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ddbcb-164f-4c27-b03f-fbfc02fa330c None admin] PATH_INFO: `/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.650479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ddbcb-164f-4c27-b03f-fbfc02fa330c None admin] RBAC: Authorizing `identity:get_project(project_id=607a002f6e7e43ff96644d4fc8c6f5d1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.652057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792ddbcb-164f-4c27-b03f-fbfc02fa330c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.655251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 68/136] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.660288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.792718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e39a8-1dfa-41e9-a92d-866f7bd69393 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.830627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd43b43-5299-4b2b-839c-8f713b6f9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.831303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43b43-5299-4b2b-839c-8f713b6f9237 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.831750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43b43-5299-4b2b-839c-8f713b6f9237 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.831886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43b43-5299-4b2b-839c-8f713b6f9237 None admin] PATH_INFO: `/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1/users/f5c4cf6a8a96407ca6d6755ef729b676/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.838393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd43b43-5299-4b2b-839c-8f713b6f9237 None admin] RBAC: Authorizing `identity:create_grant(project_id=607a002f6e7e43ff96644d4fc8c6f5d1, user_id=f5c4cf6a8a96407ca6d6755ef729b676, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.839514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd43b43-5299-4b2b-839c-8f713b6f9237 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.874117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 69/137] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:46 2022] PUT /identity/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1/users/f5c4cf6a8a96407ca6d6755ef729b676/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:47.112670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce570e-f6dc-456b-b27d-e1f2b3af9f8c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.113222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce570e-f6dc-456b-b27d-e1f2b3af9f8c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.113305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce570e-f6dc-456b-b27d-e1f2b3af9f8c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.114771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 69/138] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:47.120589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.120961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.121237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.145127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:47.146353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:47.222936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.250527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 70/139] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:47.783976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce570e-f6dc-456b-b27d-e1f2b3af9f8c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.894681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce570e-f6dc-456b-b27d-e1f2b3af9f8c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.931684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da521769-9524-4acc-81c0-409aae5368e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.932712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da521769-9524-4acc-81c0-409aae5368e7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.933180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da521769-9524-4acc-81c0-409aae5368e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.933658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da521769-9524-4acc-81c0-409aae5368e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.934918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da521769-9524-4acc-81c0-409aae5368e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.936561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da521769-9524-4acc-81c0-409aae5368e7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:47.938743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 70/140] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:47.944230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.058307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd3b81-66ff-4bd4-abbf-04ffbb75f3f5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.097499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66ecd5-6ec4-4126-91f1-4bd4148a6b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.098125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66ecd5-6ec4-4126-91f1-4bd4148a6b5e None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.098405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66ecd5-6ec4-4126-91f1-4bd4148a6b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.098676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66ecd5-6ec4-4126-91f1-4bd4148a6b5e None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.099396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66ecd5-6ec4-4126-91f1-4bd4148a6b5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.100869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66ecd5-6ec4-4126-91f1-4bd4148a6b5e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.137232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 71/141] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:47 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:48.244462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c756c-0ea7-473d-a4bb-0d70f4b07797 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.245489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c756c-0ea7-473d-a4bb-0d70f4b07797 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.245969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c756c-0ea7-473d-a4bb-0d70f4b07797 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.247991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 71/142] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:48.254532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ad26-1494-4b61-8dff-2638e6a7a3b2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.254962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ad26-1494-4b61-8dff-2638e6a7a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.255241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783ad26-1494-4b61-8dff-2638e6a7a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.280116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8783ad26-1494-4b61-8dff-2638e6a7a3b2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:48.281499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8783ad26-1494-4b61-8dff-2638e6a7a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:48.334493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:48.365614 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 72/143] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:48.821771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c756c-0ea7-473d-a4bb-0d70f4b07797 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.850032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:48.932895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c756c-0ea7-473d-a4bb-0d70f4b07797 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.968796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.969453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.969737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.970013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.982040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e2052-ce69-47e4-bd62-7dbf90c125dc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.982544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e2052-ce69-47e4-bd62-7dbf90c125dc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.982544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e2052-ce69-47e4-bd62-7dbf90c125dc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.983953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 73/144] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:48.985732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:48.989839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8f69-b977-4a6b-9b2b-b0f48d3caf74 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.990122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8f69-b977-4a6b-9b2b-b0f48d3caf74 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.990393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae8f69-b977-4a6b-9b2b-b0f48d3caf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:48.991586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:48.992493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:48.993516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:48.995446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 72/145] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:49.001286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.013409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cdae8f69-b977-4a6b-9b2b-b0f48d3caf74 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:49.014253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cdae8f69-b977-4a6b-9b2b-b0f48d3caf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:49.108260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 74/146] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:49.123169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.141293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132de26d-80ee-4f74-aa52-e49a61c95913 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.186592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.188069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.188791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.189265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.190114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:49.190599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.192198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.201623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 73/147] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:49.206231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ef2f3-6c02-43d1-adcf-a83dbdf6e86b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.206719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ef2f3-6c02-43d1-adcf-a83dbdf6e86b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.207169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ef2f3-6c02-43d1-adcf-a83dbdf6e86b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.208745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 75/148] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:49.211863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.214822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.215310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.215791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.248386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:49.249940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:49.370691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011b098-f7db-43d5-a56e-b3f2aebdda10 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.377939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 76/149] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:49.414654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.415603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.416055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.416565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] PATH_INFO: `/v3/users/b52ce65dcbe9497c8bcbed8a82e5a75b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.421321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] RBAC: Authorizing `identity:get_user(user_id=b52ce65dcbe9497c8bcbed8a82e5a75b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.423054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.424946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 74/150] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/users/b52ce65dcbe9497c8bcbed8a82e5a75b => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:49.433753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.440742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.470803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.495823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.607423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216aee9-eae8-460a-867d-55e2fe23a36c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.619376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85628a-bd1a-473f-99a1-1f45e1812bfd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.657402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.657971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.658248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.658515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.665403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.666927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.669045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 77/151] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:49.671166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.672134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.672628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.673166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.674648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.693716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:49.699386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:49.700278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:49.701093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:49.703759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 75/152] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:49.709693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.816660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.824012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256ce59-bea2-4f63-a041-80e5dce409d3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.825524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.852361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c9ffc-5e99-4cc0-8895-b6799239e452 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.882624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.883314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.883599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.883863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/b52ce65dcbe9497c8bcbed8a82e5a75b/roles/e15766d617984ae3bbe12b81d0c1a1fe` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.893502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] RBAC: Authorizing `identity:create_grant(project_id=9887ccb4f90f4b25bc965506f3b262a0, user_id=b52ce65dcbe9497c8bcbed8a82e5a75b, role_id=e15766d617984ae3bbe12b81d0c1a1fe)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.895090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.901319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.902952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.902952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.902952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.903801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:49.904300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.905988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.915198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 76/153] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:49.921207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.922897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 78/154] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:49 2022] PUT /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/users/b52ce65dcbe9497c8bcbed8a82e5a75b/roles/e15766d617984ae3bbe12b81d0c1a1fe => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:43:49.958989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.056937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833a4f-a06b-4433-ace7-f68c1b359cad None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.074224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147683cb-8dce-4461-968a-37dfdc9ce64b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.102895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.103946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.104474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.104974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] PATH_INFO: `/v3/users/bee6ddf3af8f44e6a826bfe586fc1067` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.109091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] RBAC: Authorizing `identity:get_user(user_id=bee6ddf3af8f44e6a826bfe586fc1067)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.109091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.110751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 77/155] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/users/bee6ddf3af8f44e6a826bfe586fc1067 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:50.117211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.118309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.118973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.119252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.119526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.125763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.132143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:50.139508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:50.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:50.141603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:50.146877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 79/156] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:50.148281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.175082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.257533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb5032-207d-427e-b05d-e22ceb1a69db None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.294142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.294940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.295322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.295721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.296687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:50.297093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.298638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88934-124d-4573-9626-84c8192c1552 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.312750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 80/157] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.314387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dcbad-6da7-4e65-b72b-27ae1b40a6f8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.314775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dcbad-6da7-4e65-b72b-27ae1b40a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.315142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dcbad-6da7-4e65-b72b-27ae1b40a6f8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.316767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 81/158] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:50.318816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dcbad-6da7-4e65-b72b-27ae1b40a6f8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.342128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0440-a8a7-4580-a345-26bfb099ce98 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.401156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.401955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.402242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.402568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.419408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.441897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dcbad-6da7-4e65-b72b-27ae1b40a6f8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.482213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d55f6-edd3-48c6-8328-345c4a4d5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.483130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d55f6-edd3-48c6-8328-345c4a4d5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.483510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d55f6-edd3-48c6-8328-345c4a4d5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.483980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d55f6-edd3-48c6-8328-345c4a4d5ce6 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.486521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d55f6-edd3-48c6-8328-345c4a4d5ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.488237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d55f6-edd3-48c6-8328-345c4a4d5ce6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.490467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 82/159] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:50.494449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.494943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.495316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.518436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:50.519941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:50.522735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.524243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.530431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.600316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 83/160] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:50.601886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.712781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5495c7-9bf0-4a59-9b50-a05c0ae4f432 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.716808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.753290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7463-f5f0-4701-84b8-9b70fb7c1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.754148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7463-f5f0-4701-84b8-9b70fb7c1d32 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.754520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7463-f5f0-4701-84b8-9b70fb7c1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.754893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7463-f5f0-4701-84b8-9b70fb7c1d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.756409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 78/161] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:50.761784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.833365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7463-f5f0-4701-84b8-9b70fb7c1d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.835031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7463-f5f0-4701-84b8-9b70fb7c1d32 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.904802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950460fd-c0b0-4061-8719-6ed28e618f74 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.907180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.937074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.951349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 84/162] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:50.953420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceebe9-ced8-4a34-87c1-3564ade435d5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.953832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceebe9-ced8-4a34-87c1-3564ade435d5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.954202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ceebe9-ced8-4a34-87c1-3564ade435d5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.956939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 85/163] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:50.959083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceebe9-ced8-4a34-87c1-3564ade435d5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.970328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442d672-2dca-414d-be7f-a94f32063e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.970910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d672-2dca-414d-be7f-a94f32063e61 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.971190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d672-2dca-414d-be7f-a94f32063e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.971462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d672-2dca-414d-be7f-a94f32063e61 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.973402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d672-2dca-414d-be7f-a94f32063e61 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.974875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442d672-2dca-414d-be7f-a94f32063e61 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.976527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 79/164] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.977674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.977952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.978223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.008665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:51.009879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:51.067274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ceebe9-ced8-4a34-87c1-3564ade435d5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.109290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.110441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.110741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.111102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.112321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.114071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.115893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 86/165] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:51.121373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.122969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 80/166] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:51.134333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.177095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.230261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd994bd-92d9-48bc-9798-3f0641965e95 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.267161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.267779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.268053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.268319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.269096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=bee6ddf3af8f44e6a826bfe586fc1067) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:51.269415 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.270856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.277779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 87/167] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/role_assignments?user.id=bee6ddf3af8f44e6a826bfe586fc1067&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:51.286298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3105829-bb5a-4598-9507-e0f61909cad1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.290869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.320233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.347986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.348626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.348907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.349223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.349966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=f5c4cf6a8a96407ca6d6755ef729b676) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:51.350281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.351737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.363536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 81/168] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/role_assignments?user.id=f5c4cf6a8a96407ca6d6755ef729b676&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=179c8295939541c3816444f2b7a59ae4 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:51.430550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e422ecc-986b-4100-b3dd-a180d5ce48ce None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.465069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.469174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.469877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.470386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.470636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.483443 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:51.489844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:51.490704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:51.491525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 88/169] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:51.497151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.557684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.643874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a88ec-5c6d-4742-abf8-267f9a5ca2c7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.718755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.719389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.719666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.719935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.720697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:51.721136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.722785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.740938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 82/170] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:51.747526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.793888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224ed73-c85b-48ed-bd8c-dc73b1032d41 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.813495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.874992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.875663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.875945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.876220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.901916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:51.906986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:51.908988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:51.910903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 89/171] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:51.915060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.934708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d39436-5eca-4452-ba5f-085a774d88e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.979578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.010777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.011359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.011632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.011900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.013821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.015341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.017009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 83/172] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:52.024483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.126224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe070ac-0221-40f8-8725-0c43a1aa0786 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.174328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.174953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.181013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.181308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.182007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:52.182314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.183834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.193781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 90/173] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:52.199174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.221802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.227843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2640d-b7ec-4c83-8463-8917b9d0b9dc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.287139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.287693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.287976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.288251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.319476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.327285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0fdfe-3e39-4a92-b86c-51974d3506e7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.378508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.379157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.379433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.379700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] PATH_INFO: `/v3/users/f5c4cf6a8a96407ca6d6755ef729b676` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.385298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f5c4cf6a8a96407ca6d6755ef729b676)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.386761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.388390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 91/174] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/users/f5c4cf6a8a96407ca6d6755ef729b676 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:52.395678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.412450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.414021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.565804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06809c66-4fc9-4c0c-ae7c-fa2a830d83f9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.604211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.611410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 84/175] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:52.617189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.631655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345531-710c-4690-9598-2533c32c5432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.632682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345531-710c-4690-9598-2533c32c5432 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.633167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345531-710c-4690-9598-2533c32c5432 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.633626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67345531-710c-4690-9598-2533c32c5432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.689010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.754240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67345531-710c-4690-9598-2533c32c5432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.756058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67345531-710c-4690-9598-2533c32c5432 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.802162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac589534-89d2-49d0-b1fd-83016b4a9436 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.858658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.859664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.860324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.860759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.865300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.866863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.869006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 85/176] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:52.875147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.901901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 92/177] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:52.908072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345531-710c-4690-9598-2533c32c5432 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.980999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.991006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.056173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67345531-710c-4690-9598-2533c32c5432 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.063522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702a8d3-7d5a-49a5-9e19-0e92cf16a562 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.142681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a767f-3e2b-4129-bdef-9b2e40a3ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.144437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a767f-3e2b-4129-bdef-9b2e40a3ca95 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.145361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a767f-3e2b-4129-bdef-9b2e40a3ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.146166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a767f-3e2b-4129-bdef-9b2e40a3ca95 None admin] PATH_INFO: `/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.148013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.148898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a767f-3e2b-4129-bdef-9b2e40a3ca95 None admin] RBAC: Authorizing `identity:get_project(project_id=607a002f6e7e43ff96644d4fc8c6f5d1)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.149696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.151349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a767f-3e2b-4129-bdef-9b2e40a3ca95 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.151813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.152284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.153232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] RBAC: Adding query filter params (role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=f5c4cf6a8a96407ca6d6755ef729b676) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:53.155130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 93/178] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/projects/607a002f6e7e43ff96644d4fc8c6f5d1 => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:53.155637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.157384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47615bdc-582d-4726-90cb-2b1aaf0047a3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.158761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52761594-0aff-4036-a081-0b7c5d78ddcc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.160943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52761594-0aff-4036-a081-0b7c5d78ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.161408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52761594-0aff-4036-a081-0b7c5d78ddcc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.162832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 94/179] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:53.163974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52761594-0aff-4036-a081-0b7c5d78ddcc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.176950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 86/180] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/role_assignments?user.id=f5c4cf6a8a96407ca6d6755ef729b676&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:53.178252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.178536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.178804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.231033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:53.233659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:53.343587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 87/181] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:53.409521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52761594-0aff-4036-a081-0b7c5d78ddcc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.443588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.450261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.450889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.451171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.451442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.452308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=607a002f6e7e43ff96644d4fc8c6f5d1, user.id=f5c4cf6a8a96407ca6d6755ef729b676) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:53.452662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.454178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bc21c-c35c-454c-b10c-61b10e42aeb9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.460640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 95/182] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/role_assignments?user.id=f5c4cf6a8a96407ca6d6755ef729b676&scope.project.id=607a002f6e7e43ff96644d4fc8c6f5d1&role.id=179c8295939541c3816444f2b7a59ae4 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:53.708716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.777515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40034898-cd45-4c33-850a-f7def2a2a34a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.777841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40034898-cd45-4c33-850a-f7def2a2a34a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.778060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40034898-cd45-4c33-850a-f7def2a2a34a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.779567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 96/183] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:53.785831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12449b-6a2d-4dbc-8530-fa7f25659ef1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.786401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12449b-6a2d-4dbc-8530-fa7f25659ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.786880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12449b-6a2d-4dbc-8530-fa7f25659ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.791866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.815426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1c12449b-6a2d-4dbc-8530-fa7f25659ef1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:53.816670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1c12449b-6a2d-4dbc-8530-fa7f25659ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:53.866948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1363295-62ec-42e9-aea2-0e8a8ea0abf7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.909548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.910199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.910473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.910741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.912892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 97/184] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:53.914098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9305-5a60-491a-beb2-141fb4580427 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.914452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9305-5a60-491a-beb2-141fb4580427 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.914862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9305-5a60-491a-beb2-141fb4580427 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.916223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 98/185] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:53.922286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d550e88-546f-481b-8b4b-2f7d210453e8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.922560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d550e88-546f-481b-8b4b-2f7d210453e8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.922956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d550e88-546f-481b-8b4b-2f7d210453e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.927738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:53.932889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:53.933851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:53.934632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:53.939260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 88/186] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:53.940682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.943958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5d550e88-546f-481b-8b4b-2f7d210453e8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:53.945421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5d550e88-546f-481b-8b4b-2f7d210453e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:54.028273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 99/187] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:54.054774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d123-6f46-40b7-9024-eba18625d131 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.055061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d123-6f46-40b7-9024-eba18625d131 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.055335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052d123-6f46-40b7-9024-eba18625d131 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.056992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 100/188] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:54.061700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.061985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.062324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.082617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e53c-7849-4fe0-b85d-11410392d9f8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.088986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:54.090169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:54.103593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.127292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.127907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.128181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.128460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.129274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:54.129571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.131217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.144705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 89/189] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:54.148786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.151711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.170978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 101/190] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:54.241681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.261279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb00f4-8121-4ab1-8e6f-9a417db7dca1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.305986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.306663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.306938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.307205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] PATH_INFO: `/v3/users/b92b54f12c3b4fc39677d74a45cacea5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.323662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] RBAC: Authorizing `identity:get_user(user_id=b92b54f12c3b4fc39677d74a45cacea5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.325159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.326961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 90/191] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/users/b92b54f12c3b4fc39677d74a45cacea5 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:54.327654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.347177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd074c-753b-4158-8844-8c4244d4076d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.369476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.382293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.382938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.383221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.383497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.384601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.386071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.387658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 102/192] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:54.388404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.442643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d0a2-e8cb-41df-8db2-91eb9e747942 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.449783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.475772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.476406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.476707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.476975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.487420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:54.492264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:54.493213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:54.493999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:54.494592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f13b8-fd0a-49af-a5fc-c949fed68d69 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.494663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 91/193] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:54.494663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.527438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.528049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.528376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.528666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.588028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.592369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cce6bd-4594-43be-b9f0-1330fc8bb897 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.592596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.594277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.626187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.626798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.627071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.627350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.628003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.629513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.647208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.651134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 92/194] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:54 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:54.653835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.700557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 103/195] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:54.701991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.773264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5744fc-830b-4f2f-8bd1-1ad7d6246df8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.810208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.810866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.811147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.811419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.823102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:54.828568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:54.829635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:54.830555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 93/196] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:54.831288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.831844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ff232-d3e0-45bc-aee1-93180ce9b22b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.851699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.875425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.876044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.876320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.876589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.877315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:54.877609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.879234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.888327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 104/197] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:54.889700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.911556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.960485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4caa0-6742-49ea-859b-4c27a343da6e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.998878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.999539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.999844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.000112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.001243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.002688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.004316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 94/198] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.005216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.026219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c831e6-0de7-4f25-8e58-8bc6101ce1a1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.077118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.077768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.078044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.078310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.079034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:55.079791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.081478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.090799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 105/199] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.091611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.112086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.131009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7ff8d-6109-4578-940c-633abd64f23e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.169371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.170019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.170290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.170560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] PATH_INFO: `/v3/users/b52ce65dcbe9497c8bcbed8a82e5a75b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.177603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] RBAC: Authorizing `identity:get_user(user_id=b52ce65dcbe9497c8bcbed8a82e5a75b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.180108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.182051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 95/200] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/users/b52ce65dcbe9497c8bcbed8a82e5a75b => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.185200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.191334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.217468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada31769-286d-43dd-9d6f-8eefb0359fae None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.257232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.257999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.258374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.259164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.260007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=b92b54f12c3b4fc39677d74a45cacea5) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:55.260754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.262317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.269400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 106/201] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/role_assignments?user.id=b92b54f12c3b4fc39677d74a45cacea5&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.277808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.354021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e76774-1eb7-47a5-9902-61222ec7e18f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.398789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.399540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.399697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.399971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] PATH_INFO: `/v3/users/b92b54f12c3b4fc39677d74a45cacea5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.401204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] RBAC: Authorizing `identity:get_user(user_id=b92b54f12c3b4fc39677d74a45cacea5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.402679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.404687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 96/202] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/users/b92b54f12c3b4fc39677d74a45cacea5 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.409796 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b5a8-7e98-49d2-b281-6e4e38abd90b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.410676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.444445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.474846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.477021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.477733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.478002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.492223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.586758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.588263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.598266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d6c02-3a81-43d0-b98f-f00cf7917468 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.675259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.676247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.676744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.677201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.749023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 107/203] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:55.755337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.828988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.857758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.859333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.893303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7088c-7444-4f9b-ab43-f2ef863b48ab None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.909953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.930526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.931104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.931387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.931661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.932874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.934565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.936221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 108/204] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:55.942242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.049856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b00156-52b3-4c8b-bccd-0591b48c005a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.086878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.087648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.088032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.088428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.089411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] RBAC: Adding query filter params (role.id=e15766d617984ae3bbe12b81d0c1a1fe, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0, user.id=b52ce65dcbe9497c8bcbed8a82e5a75b) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:56.089824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.091368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.095475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.105733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 109/205] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/role_assignments?user.id=b52ce65dcbe9497c8bcbed8a82e5a75b&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=e15766d617984ae3bbe12b81d0c1a1fe => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:56.159972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 97/206] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:56.166045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.277974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48855488-5ec7-42dc-998f-4f844033824a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.314236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6e2e5-ac6d-457e-9f03-cda70b083fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.314940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e2e5-ac6d-457e-9f03-cda70b083fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.315229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e2e5-ac6d-457e-9f03-cda70b083fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.315645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6e2e5-ac6d-457e-9f03-cda70b083fc9 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.317196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e2e5-ac6d-457e-9f03-cda70b083fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.318765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6e2e5-ac6d-457e-9f03-cda70b083fc9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.320860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 110/207] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:56.329798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.450045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714cb5-bf32-4388-b8c7-0c6d9b76db87 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.472587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.490617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.491230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.491500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.491761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.492478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] RBAC: Adding query filter params (role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=b92b54f12c3b4fc39677d74a45cacea5) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:56.492820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.494245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684e95b-81d4-49e7-96fc-1427474fc2fc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.502087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 98/208] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/role_assignments?user.id=b92b54f12c3b4fc39677d74a45cacea5&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:57.269995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d1c1-e6b1-43ca-adce-44e6c2282e8c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.270409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d1c1-e6b1-43ca-adce-44e6c2282e8c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.270584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d1c1-e6b1-43ca-adce-44e6c2282e8c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.272094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 111/209] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:57.278090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.278563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.278663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.279122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3c82-bba4-4678-aac9-18e35480158d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.279480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3c82-bba4-4678-aac9-18e35480158d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.279657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb3c82-bba4-4678-aac9-18e35480158d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.281335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 112/210] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:57.287729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3a7e-d0a1-4956-b7ac-f9775e47be0f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.288004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3a7e-d0a1-4956-b7ac-f9775e47be0f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.288279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3a7e-d0a1-4956-b7ac-f9775e47be0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.298941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:57.300182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:57.310165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0b5c3a7e-d0a1-4956-b7ac-f9775e47be0f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:57.311335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0b5c3a7e-d0a1-4956-b7ac-f9775e47be0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:57.361227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.382083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 99/211] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:57.395611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 113/212] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:57.650768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.664125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2ee9-88b1-4b2f-b152-11158ec17574 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.664788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2ee9-88b1-4b2f-b152-11158ec17574 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.665266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2ee9-88b1-4b2f-b152-11158ec17574 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.667147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 114/213] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:57.672880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.673440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.673972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.693369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:57.694661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:57.765678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb2122-d2d3-4f33-9c35-62d7cd23d138 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.770008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 115/214] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:57.771010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.783776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.816477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.817512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.818003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.818455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.832171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:57.838821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:57.839690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:57.840462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:57.842062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 100/215] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:57.849792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.890480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3674a9a-07ba-4e80-a219-238d962550bc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.921057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.928937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.929648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.930013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.930387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.931619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.933152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.934969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 116/216] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:57.940232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.957172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860f3ea-6e76-4633-bb6d-be6f2c32022b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.993542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.994493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.994994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.995493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.996347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:57.996884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.998571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.013522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 101/217] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:58.014679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.046026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366d343-a724-4cf3-ba9d-5c94fffc3632 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.051473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.081676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.082283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.082559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.082820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.083471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.085401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.112029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 117/218] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:57 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:58.112994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.147514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dad5a-9443-4e82-9516-0e95ca3b58e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.161374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.209542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.211382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.212029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.212594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] PATH_INFO: `/v3/users/7fa4d16a39de447780961e53515de2d0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.233898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] RBAC: Authorizing `identity:get_user(user_id=7fa4d16a39de447780961e53515de2d0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.237504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.239584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 102/219] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/users/7fa4d16a39de447780961e53515de2d0 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:58.246905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.260007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40675f6b-bc6f-4fd1-a076-07fa98da6a2a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.298996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.299635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.299635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.299635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.311171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:58.317204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:58.318120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:43:58.318901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 118/220] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:58.324182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.372304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.383188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d9eb0-dbca-416b-8ff1-e3deaa3a141a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.426618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.429261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.430692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.430980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.431489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.444584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21416e-68c5-4c82-bd38-e1fa70a5341a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.489516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.490524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.491006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.491467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.492335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:58.492874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.494450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.503848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 119/221] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:58.509449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.519724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.521266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.629131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.634311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983011a8-b064-4e53-84dd-9202af124e33 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.642879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 103/222] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:58.650652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.681316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.682440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.682938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.683447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] PATH_INFO: `/v3/users/b92b54f12c3b4fc39677d74a45cacea5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.684820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] RBAC: Authorizing `identity:get_user(user_id=b92b54f12c3b4fc39677d74a45cacea5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.686713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.690477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 120/223] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/users/b92b54f12c3b4fc39677d74a45cacea5 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:58.696185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.716266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.771707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed9550-be61-4eb7-ada3-bc394be70423 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.801476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb58fc0-f454-40a5-b5a9-2a689e22f239 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.829464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18316701-6537-4e8e-a62b-cb169b71384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.830106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18316701-6537-4e8e-a62b-cb169b71384c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.830380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18316701-6537-4e8e-a62b-cb169b71384c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.830648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18316701-6537-4e8e-a62b-cb169b71384c None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.832393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18316701-6537-4e8e-a62b-cb169b71384c None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.833883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18316701-6537-4e8e-a62b-cb169b71384c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.835838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 104/224] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:58.837031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad32c-e4d4-4c0d-842a-b7683f76657d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.837310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad32c-e4d4-4c0d-842a-b7683f76657d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.837648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aad32c-e4d4-4c0d-842a-b7683f76657d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.838952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 105/225] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:43:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:58.843886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aad32c-e4d4-4c0d-842a-b7683f76657d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:58.846296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c076b1c-cd37-4030-ba37-d1da029af79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.848474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c076b1c-cd37-4030-ba37-d1da029af79b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.849005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c076b1c-cd37-4030-ba37-d1da029af79b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.849481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c076b1c-cd37-4030-ba37-d1da029af79b None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.850859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c076b1c-cd37-4030-ba37-d1da029af79b None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.852575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c076b1c-cd37-4030-ba37-d1da029af79b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.855785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 121/226] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:58.857782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.858265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.858748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.884164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:58.886959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:58.911668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.955730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aad32c-e4d4-4c0d-842a-b7683f76657d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.985818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 122/227] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:58.987174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:59.004086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:59.007098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:59.007724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:59.008102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:59.008297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:59.009166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=7fa4d16a39de447780961e53515de2d0) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:59.009470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:59.010975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:59.028819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 106/228] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:58 2022] GET /identity/v3/role_assignments?user.id=7fa4d16a39de447780961e53515de2d0&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=179c8295939541c3816444f2b7a59ae4 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:59.123243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92781f8-be9b-4be3-82f6-1459ff0b9b3e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:59.165340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:59.166033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:59.166305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:59.166567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/b92b54f12c3b4fc39677d74a45cacea5/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:59.170302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c710741c8a7d4e1c97de76102643ced7, user_id=b92b54f12c3b4fc39677d74a45cacea5, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:59.171888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:59.203251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 123/229] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:58 2022] PUT /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/b92b54f12c3b4fc39677d74a45cacea5/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:59.340514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:59.477204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034c014-d6bb-47b7-8362-a465e917f49a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:59.518512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:59.531902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:59.532889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:59.533300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:59.533726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:59.544573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:59.549643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:59.550703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:59.551700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:43:59.554005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 107/230] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:59.560438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:59.643795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:59.675193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981041f-db85-45d8-9358-fcbf6c2043e7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:59.718744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:59.719368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:59.719643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:59.719910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:59.720579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:59.720899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:59.722269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:59.735719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 124/231] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:59.737376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:59.900420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea998d0a-28c1-4d04-8c74-32caac8d6f4f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:59.941872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:59.942517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:59.942790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:59.943054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] PATH_INFO: `/v3/users/b92b54f12c3b4fc39677d74a45cacea5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:59.944197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] RBAC: Authorizing `identity:get_user(user_id=b92b54f12c3b4fc39677d74a45cacea5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:59.945723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:59.947473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 108/232] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:59 2022] GET /identity/v3/users/b92b54f12c3b4fc39677d74a45cacea5 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:59.953152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:00.074526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760efe53-ff66-4efa-8353-5f6e702c03ef None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:00.110977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56064190-4b31-4cf0-b117-107121c82919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:00.111619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064190-4b31-4cf0-b117-107121c82919 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.111893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064190-4b31-4cf0-b117-107121c82919 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.112158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56064190-4b31-4cf0-b117-107121c82919 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.117357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56064190-4b31-4cf0-b117-107121c82919 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:00.118816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56064190-4b31-4cf0-b117-107121c82919 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:00.120450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 125/233] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:59 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:00.126455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:00.198539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:00.246081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65df45-5127-4740-a268-514b00413c8a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:00.290225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200e78d-bc4d-4332-9f02-b57e94bb449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:00.290953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e78d-bc4d-4332-9f02-b57e94bb449b None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.291228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e78d-bc4d-4332-9f02-b57e94bb449b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.291526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200e78d-bc4d-4332-9f02-b57e94bb449b None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/b92b54f12c3b4fc39677d74a45cacea5/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.294448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200e78d-bc4d-4332-9f02-b57e94bb449b None admin] RBAC: Authorizing `identity:create_grant(project_id=c710741c8a7d4e1c97de76102643ced7, user_id=b92b54f12c3b4fc39677d74a45cacea5, role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:00.296099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200e78d-bc4d-4332-9f02-b57e94bb449b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:00.326350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 109/234] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:00 2022] PUT /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/b92b54f12c3b4fc39677d74a45cacea5/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:00.880467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae008-e899-49b9-8307-738386ea1faf None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.881019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae008-e899-49b9-8307-738386ea1faf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.881019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bae008-e899-49b9-8307-738386ea1faf None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.882413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 126/235] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:00.887647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32599b9d-85d0-47b6-bbf4-d9b1afb70327 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.888035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32599b9d-85d0-47b6-bbf4-d9b1afb70327 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.888266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32599b9d-85d0-47b6-bbf4-d9b1afb70327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.906925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-32599b9d-85d0-47b6-bbf4-d9b1afb70327 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:00.908111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-32599b9d-85d0-47b6-bbf4-d9b1afb70327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:00.976040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 110/236] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:00.987694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eac19-7193-48f0-bf95-e8c3fe7b2d3f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.987992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eac19-7193-48f0-bf95-e8c3fe7b2d3f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.988252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eac19-7193-48f0-bf95-e8c3fe7b2d3f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.989640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 127/237] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:01.006000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.006291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.006566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.033620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:01.034828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.071502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.105158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 111/238] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:01.314897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eac19-7193-48f0-bf95-e8c3fe7b2d3f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.318887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.401844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.449539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eac19-7193-48f0-bf95-e8c3fe7b2d3f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.518096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.519151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.519612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.520063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.540533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:01.545654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:01.546545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:01.547330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:01.554242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 128/239] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:01.559478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.586389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be19d-b502-4511-a864-0ed5e9e7b541 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.625943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.651608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.652572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.653114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.653538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.656765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.658598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.661579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 112/240] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:01.668172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.703396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b27848-4bce-4cec-954b-4c2c70ee2ad4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.748508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.749067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.749508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.749846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.750113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.753139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:01.753474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.754926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.780939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 129/241] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:01.793736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.840150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f7bf7-65da-414a-88e7-051af2e08d14 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.901591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b0983-35b6-4469-af57-253a3f5c7803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.902247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b0983-35b6-4469-af57-253a3f5c7803 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.902509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b0983-35b6-4469-af57-253a3f5c7803 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.902776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b0983-35b6-4469-af57-253a3f5c7803 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.903429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b0983-35b6-4469-af57-253a3f5c7803 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.904958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b0983-35b6-4469-af57-253a3f5c7803 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.930616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 113/242] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:01 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:44:01.931997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cbb85-4bd5-431a-8648-3d428586d8fd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.932847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cbb85-4bd5-431a-8648-3d428586d8fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.933169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cbb85-4bd5-431a-8648-3d428586d8fd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.936739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 114/243] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:01.941087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7fe1-a802-490b-bfdb-ae0cd832b966 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.941494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7fe1-a802-490b-bfdb-ae0cd832b966 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.941854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c7fe1-a802-490b-bfdb-ae0cd832b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.952921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0383e68-961a-4161-b4f2-876e8d25a83e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.962002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-224c7fe1-a802-490b-bfdb-ae0cd832b966 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:01.963436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-224c7fe1-a802-490b-bfdb-ae0cd832b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.987391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.000324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.001022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.001567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.001845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] PATH_INFO: `/v3/users/4ad41ea0304f4c189a912680cdbae466` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.017447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad41ea0304f4c189a912680cdbae466)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.019149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.022526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 130/244] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/users/4ad41ea0304f4c189a912680cdbae466 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:02.028213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.051727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 115/245] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:02.186945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700321-af82-49ce-bd0f-f35bde3fa912 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.225462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012f8b-f559-44a5-9002-1825280505f0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.225782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012f8b-f559-44a5-9002-1825280505f0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.226001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012f8b-f559-44a5-9002-1825280505f0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.227812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 116/246] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:02.232476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.232782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.233054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.243963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.244840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.245307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.245768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.255600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:02.258124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:02.287306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.310849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.329824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.331704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.351352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 117/247] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:02.438391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 131/248] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:44:02.448708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.448859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.552734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.574301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d9856-cdf2-48f4-aaf1-5a27212fef07 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.577525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadbd01-b8df-4123-8720-b92f13ed8e44 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.619943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.620592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.620916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.621184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.622386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.623696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.623819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.624347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.624680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.624960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.626646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 118/249] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:02.631643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.641226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:02.647805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:02.648745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:02.649528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:02.650205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 132/250] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:02.650641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.660383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.754652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c1466-a51d-4a11-8503-e9794508e525 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.787845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4201cc-d9c3-41d6-b973-34b60e4c057b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.799524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.800654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.800931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.801567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.814468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:02.821378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:02.822261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:02.823033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:02.824134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 119/251] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:02.824638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.835272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.835898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.836176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.836447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.837249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] RBAC: Adding query filter params (role.id=e15766d617984ae3bbe12b81d0c1a1fe, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=4ad41ea0304f4c189a912680cdbae466) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:02.837569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.839542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.848205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 133/252] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/role_assignments?user.id=4ad41ea0304f4c189a912680cdbae466&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=e15766d617984ae3bbe12b81d0c1a1fe => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:02.848938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.866369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.929047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.953125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d87c0b-b90a-41f8-b51c-5cfebb8401ec None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.996662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bae4-36b8-4ceb-9a7d-121dd8813c00 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.050150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.050697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.050970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.051235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.051905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:03.052198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.053625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.074400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 120/253] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:03.078408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.096333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.097006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.097282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.097542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.098224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:03.098516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.099907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.118220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 134/254] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:03.125501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.241324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.268904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070f85-0b49-4564-88d0-b0764d95abe4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.304444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c86c5-2f1c-4a82-8f64-dc47e3b21b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.305460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c86c5-2f1c-4a82-8f64-dc47e3b21b5b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.305934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c86c5-2f1c-4a82-8f64-dc47e3b21b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.306594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c86c5-2f1c-4a82-8f64-dc47e3b21b5b None admin] PATH_INFO: `/v3/users/b92b54f12c3b4fc39677d74a45cacea5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.307930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c86c5-2f1c-4a82-8f64-dc47e3b21b5b None admin] RBAC: Authorizing `identity:get_user(user_id=b92b54f12c3b4fc39677d74a45cacea5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.309702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c86c5-2f1c-4a82-8f64-dc47e3b21b5b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.311544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 135/255] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/users/b92b54f12c3b4fc39677d74a45cacea5 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:03.313454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd246-1c30-4cc5-9a9e-618c55a7959f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.318253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd246-1c30-4cc5-9a9e-618c55a7959f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.318748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd246-1c30-4cc5-9a9e-618c55a7959f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.320560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 136/256] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:03.322111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdd246-1c30-4cc5-9a9e-618c55a7959f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.358569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec1342-53e0-4a62-8016-1dff85378b6c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.434154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdd246-1c30-4cc5-9a9e-618c55a7959f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.453432 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cbae4-ff4a-4b05-bb2f-8fe20e3be6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.454102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbae4-ff4a-4b05-bb2f-8fe20e3be6ee None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.454375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbae4-ff4a-4b05-bb2f-8fe20e3be6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.454644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbae4-ff4a-4b05-bb2f-8fe20e3be6ee None admin] PATH_INFO: `/v3/users/7fa4d16a39de447780961e53515de2d0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.461350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cbae4-ff4a-4b05-bb2f-8fe20e3be6ee None admin] RBAC: Authorizing `identity:get_user(user_id=7fa4d16a39de447780961e53515de2d0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.462851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22cbae4-ff4a-4b05-bb2f-8fe20e3be6ee None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.464485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 121/257] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/users/7fa4d16a39de447780961e53515de2d0 => generated 297 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:03.465694 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.465970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.466236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.474332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.475326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.475799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.476258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.496993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.514017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:03.515230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:03.539174 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.556292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.558321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.671867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 137/258] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:44:03.673079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.724971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.726307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 122/259] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:03.727225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.788263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e329-64a2-4a73-bf9a-5f055538e057 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.826861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.827830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.828289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.828757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.830198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.831854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.833915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 138/260] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:03.840996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.946667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96d14b-1ead-47a7-b14f-e5b6f8d3f87b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.949403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989050a-e8ac-4d1a-bb0a-06226134d864 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.961010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.986471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.987447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.988217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.989229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/7fa4d16a39de447780961e53515de2d0/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.992853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=c710741c8a7d4e1c97de76102643ced7, user_id=7fa4d16a39de447780961e53515de2d0, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.994737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:04.009973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:04.010723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.010996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.011263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.012100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 139/261] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:03 2022] PUT /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/7fa4d16a39de447780961e53515de2d0/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:04.017543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:04.019053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:04.021089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 123/262] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:04.027888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:04.157890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fccd5-ffb8-4e18-be17-9c0c1eab8f1b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:04.196344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:04.197318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.197804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.198268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.199224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=b92b54f12c3b4fc39677d74a45cacea5) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:04.199714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:04.201488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:04.209599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 140/263] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/role_assignments?user.id=b92b54f12c3b4fc39677d74a45cacea5&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:04.281160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:04.298511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:04.414741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa48407-0ad5-4d95-a166-f7428f6ba6d5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:04.468555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:04.469213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.469490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.469754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.483186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:04.488450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:04.489488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:04.490270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 124/264] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:04.496347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:04.545160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:04.635532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22781ad0-6ed3-438e-bea9-e70e3a7a99dc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:04.670800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:04.671344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.671661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.671930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.672685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:04.672992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:04.674442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:04.683265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 141/265] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:04.689356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:04.795212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:04.832112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548b03f-0645-4a12-bab8-ba2088cf9ec1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:04.877341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:04.877996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.878266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.878529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] PATH_INFO: `/v3/users/b92b54f12c3b4fc39677d74a45cacea5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.879685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] RBAC: Authorizing `identity:get_user(user_id=b92b54f12c3b4fc39677d74a45cacea5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:04.881201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:04.882794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 125/266] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/users/b92b54f12c3b4fc39677d74a45cacea5 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:04.892119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.020124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818280-3e04-44e6-bc57-de3c5b0346e6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.026057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.058341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ac6e4-d3df-412c-b7dd-122c5751784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:05.058962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac6e4-d3df-412c-b7dd-122c5751784e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.059242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac6e4-d3df-412c-b7dd-122c5751784e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.059516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac6e4-d3df-412c-b7dd-122c5751784e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.129428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ac6e4-d3df-412c-b7dd-122c5751784e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:05.130934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ac6e4-d3df-412c-b7dd-122c5751784e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:05.221027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.230062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 142/267] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:05.237704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.392792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502732a6-fa63-4b7e-bbf3-68e18f6a8f88 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.427581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:05.428634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.429102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.429556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.430864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:05.431673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4756da-7aa9-4e05-9127-49412d08b774 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.432000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4756da-7aa9-4e05-9127-49412d08b774 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.432406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4756da-7aa9-4e05-9127-49412d08b774 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.433139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:05.435255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 126/268] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:05.438483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 143/269] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:05.443427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.445341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3ea9-30f7-438e-aad2-8569061561f7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.445632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3ea9-30f7-438e-aad2-8569061561f7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.445908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3ea9-30f7-438e-aad2-8569061561f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.455836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.471183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-904f3ea9-30f7-438e-aad2-8569061561f7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:05.472814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-904f3ea9-30f7-438e-aad2-8569061561f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:05.544117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bdc13-c167-4965-80af-9b9a4c405815 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.547868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 144/270] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:05.549459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e5473-639f-4d35-ad4d-14835c686ad7 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.549982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e5473-639f-4d35-ad4d-14835c686ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.550435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e5473-639f-4d35-ad4d-14835c686ad7 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.551965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 145/271] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:05.557438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd1b5-7f4e-4934-b7cf-6952068d57b6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.558189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd1b5-7f4e-4934-b7cf-6952068d57b6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.559152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cd1b5-7f4e-4934-b7cf-6952068d57b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.578801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:05.579468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.579740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.580003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.580744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] RBAC: Adding query filter params (role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=b92b54f12c3b4fc39677d74a45cacea5) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:05.581047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:05.581281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-224cd1b5-7f4e-4934-b7cf-6952068d57b6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:05.582485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:05.582932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-224cd1b5-7f4e-4934-b7cf-6952068d57b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:05.588780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 127/272] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/role_assignments?user.id=b92b54f12c3b4fc39677d74a45cacea5&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:05.666064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 146/273] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:05.828157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.883327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4cc0-ef41-408c-b219-b145aac5f25e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.883844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4cc0-ef41-408c-b219-b145aac5f25e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.884278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4cc0-ef41-408c-b219-b145aac5f25e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.886357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 147/274] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:05.891970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.892258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.892534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.911810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:05.913067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:05.923761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.963388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91130e-e1e8-4b21-a349-e124f411f67b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.971720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.986524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 148/275] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:06.001099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.002044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.002504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.002956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.014069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:06.020097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.021000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:06.021775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:06.024257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 128/276] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:06.029777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.072194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.151618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbec0b9-1f9d-4edc-9352-3f475f1130d1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.198478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.199536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.200001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.200453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.201348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.201833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.202014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcdff4-feda-4124-96f9-18292a87f525 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.203745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.216734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 149/277] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.222454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.242239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.247777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.248544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.249016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.249422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.250739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.252668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.254475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 129/278] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:06.261970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.277937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.337775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ba255-cbc6-4847-9ae3-e461b05c5b74 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.371437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.371642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482355b6-108e-42fa-a6ab-6d86c66539e1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.372070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.372346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.372644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] PATH_INFO: `/v3/users/e9357d5dd6ba4801ae53e2471b44a32e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.386785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] RBAC: Authorizing `identity:get_user(user_id=e9357d5dd6ba4801ae53e2471b44a32e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.388510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.395354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 150/279] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/users/e9357d5dd6ba4801ae53e2471b44a32e => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:06.396237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.404860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.405476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.405749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.406047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.406705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.408139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.435877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 130/280] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:06 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:44:06.437097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.515759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042e43a-fd6e-4aa0-a280-2111f0039434 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.518833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.532178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.571072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.572459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.572958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.573433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.588339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:06.591359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79400f-30d8-4d6f-8540-cc8424ac68af None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:06.595352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.596285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:06.597127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:06.604866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 151/281] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:06.605693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.641201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.641854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.642558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.642558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.643108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, user.id=e9357d5dd6ba4801ae53e2471b44a32e, scope.system=all) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.643409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.645989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb5a75-8c9c-4649-9b5b-a8c31a94c721 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.653363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 131/282] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/role_assignments?user.id=e9357d5dd6ba4801ae53e2471b44a32e&scope.system=all&role.id=179c8295939541c3816444f2b7a59ae4 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.737829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a1ff0-1ab6-4998-b560-2c5c4730410b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.777779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.778329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.778611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.778945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.779568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.779869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.781852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.782385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa97b8-8672-44c4-8b2e-f3a494960279 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.782673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa97b8-8672-44c4-8b2e-f3a494960279 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.782952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa97b8-8672-44c4-8b2e-f3a494960279 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.785191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 132/283] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:06.791434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.791618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 152/284] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.791694 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.791760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.797106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.822136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:06.824359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:06.828242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.922609 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 133/285] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:06.935005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85675-286c-4321-ac96-07f05d9a2456 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.969519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.970169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.970446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.970714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] PATH_INFO: `/v3/users/4ad41ea0304f4c189a912680cdbae466` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.971851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] RBAC: Authorizing `identity:get_user(user_id=4ad41ea0304f4c189a912680cdbae466)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.973409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.975350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 153/286] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/users/4ad41ea0304f4c189a912680cdbae466 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:06.980734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.033154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.092559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a591a1-3c09-42ab-af19-54aaa0c1edab None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.130847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.131494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.131775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.132043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.133192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.134642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.136283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 134/287] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.142160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.240650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.300170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.321747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff06d5-e2ca-4d23-8201-7857a2dcc62b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.360879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.361852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.362303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.362745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/4ad41ea0304f4c189a912680cdbae466/roles/e15766d617984ae3bbe12b81d0c1a1fe` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.364951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] RBAC: Authorizing `identity:create_grant(project_id=c710741c8a7d4e1c97de76102643ced7, user_id=4ad41ea0304f4c189a912680cdbae466, role_id=e15766d617984ae3bbe12b81d0c1a1fe)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.366581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.386759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 154/288] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:07 2022] PUT /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7/users/4ad41ea0304f4c189a912680cdbae466/roles/e15766d617984ae3bbe12b81d0c1a1fe => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:07.430585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c0c8-fcc4-4cc3-a64e-66ce5676620f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.451179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.469738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.470581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.470923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.471258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.485749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:07.491066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:07.491981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:07.492799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 135/289] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:07.502164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.650810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6b052-207c-42c1-ac3f-0228249993bc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.693138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.694155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.694635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.695143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.696167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:07.696724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.698409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.709530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 155/290] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.715221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.875448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc252f78-e24f-4448-8822-c88df890bfce None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.924119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.924709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.924985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.925253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] PATH_INFO: `/v3/users/7fa4d16a39de447780961e53515de2d0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.926368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] RBAC: Authorizing `identity:get_user(user_id=7fa4d16a39de447780961e53515de2d0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.927814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.929830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 136/291] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/users/7fa4d16a39de447780961e53515de2d0 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.935391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.959150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.080106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdebcd-98cd-48ef-9970-dfe8aeb14e17 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.132062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.133108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.133585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.134048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.210854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.213167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.232127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.351993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 156/292] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:08.357800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.434932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.519252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd814-7571-4e3b-b36f-37220d460036 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.570245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f661c-d5df-436b-8068-49a6b8745d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.570939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f661c-d5df-436b-8068-49a6b8745d17 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.571213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f661c-d5df-436b-8068-49a6b8745d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.571479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f661c-d5df-436b-8068-49a6b8745d17 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.572598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f661c-d5df-436b-8068-49a6b8745d17 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.574064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f661c-d5df-436b-8068-49a6b8745d17 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.576048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 137/293] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:08.581705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.699772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b50507-6b17-4b14-adf1-3ec6b5ea9b30 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.713786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.738675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.739294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.739568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.739835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.740564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=7fa4d16a39de447780961e53515de2d0) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:08.740889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.742318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345917c6-1341-4d2b-8b48-766765e17425 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.753075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 157/294] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/role_assignments?user.id=7fa4d16a39de447780961e53515de2d0&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=179c8295939541c3816444f2b7a59ae4 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.107071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bde5f-15eb-46a2-a853-1ed9c190049d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.107349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bde5f-15eb-46a2-a853-1ed9c190049d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.107852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bde5f-15eb-46a2-a853-1ed9c190049d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.109740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 138/295] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:09.116666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f57d6-5aec-49f5-aaa5-de00c3a5391e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.117125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f57d6-5aec-49f5-aaa5-de00c3a5391e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.117648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f57d6-5aec-49f5-aaa5-de00c3a5391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.137602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-152f57d6-5aec-49f5-aaa5-de00c3a5391e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:09.139370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-152f57d6-5aec-49f5-aaa5-de00c3a5391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:09.209519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 158/296] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:09.252559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bcb74-1ce1-4a28-9141-0b2c606508c4 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.253211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bcb74-1ce1-4a28-9141-0b2c606508c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.253732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bcb74-1ce1-4a28-9141-0b2c606508c4 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.255695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 139/297] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:09.260545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.261404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.261886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.280459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:09.282072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:09.357761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 159/298] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:09.503515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bcb74-1ce1-4a28-9141-0b2c606508c4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.617123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bcb74-1ce1-4a28-9141-0b2c606508c4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.637736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.644875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.659450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.660085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.660357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.660649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.671299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:09.676509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:09.677440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:09.678228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 140/299] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:09.684471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.689829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.757213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c5a31-9caa-4c9b-a081-e69fee43ce4d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.791419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db6f1b-8c92-4711-8aba-31bd34eb4e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.792359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db6f1b-8c92-4711-8aba-31bd34eb4e43 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.792818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db6f1b-8c92-4711-8aba-31bd34eb4e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.793078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db6f1b-8c92-4711-8aba-31bd34eb4e43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.797866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30762cf-da81-4407-aa83-52f6397bf757 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.803376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db6f1b-8c92-4711-8aba-31bd34eb4e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e2db6f1b-8c92-4711-8aba-31bd34eb4e43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:09.808293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:09.809202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 160/300] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:09.810878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c231-e313-43ad-9d06-fff521c884f9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.811592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c231-e313-43ad-9d06-fff521c884f9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.811592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c231-e313-43ad-9d06-fff521c884f9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.812523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 161/301] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:09.815086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c231-e313-43ad-9d06-fff521c884f9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.839868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.840490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.840804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.841074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.841734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.842033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.843500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f81bd3-403c-4df9-9e55-48dc90783603 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.852285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 141/302] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.853464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.853751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.854026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.871913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:09.873069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:09.903350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.924754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.930267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c231-e313-43ad-9d06-fff521c884f9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.943919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 142/303] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:09.944698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.976009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.977188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.977741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.978239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.980538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.981252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.982970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.000993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 162/304] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:10.002541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.072356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218e55a-21c7-4a50-91f8-db1c39e75013 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.106040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514ea1b-43d7-42fc-a469-cf877aeb7b11 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.115346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1282d3-ddd8-4390-9123-6365cdffdc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.115990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1282d3-ddd8-4390-9123-6365cdffdc94 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.116267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1282d3-ddd8-4390-9123-6365cdffdc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.116534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1282d3-ddd8-4390-9123-6365cdffdc94 None admin] PATH_INFO: `/v3/users/e9357d5dd6ba4801ae53e2471b44a32e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.117684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1282d3-ddd8-4390-9123-6365cdffdc94 None admin] RBAC: Authorizing `identity:get_user(user_id=e9357d5dd6ba4801ae53e2471b44a32e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.119139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1282d3-ddd8-4390-9123-6365cdffdc94 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.120736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 143/305] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/users/e9357d5dd6ba4801ae53e2471b44a32e => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.121906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e3ab-a1d7-4bb2-87d3-48dbbaca593a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.122241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e3ab-a1d7-4bb2-87d3-48dbbaca593a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.122463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7e3ab-a1d7-4bb2-87d3-48dbbaca593a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.123648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 144/306] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:10.128730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7e3ab-a1d7-4bb2-87d3-48dbbaca593a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.150817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887c599-11c3-4f57-aa21-6bbf1ad7d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.151452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887c599-11c3-4f57-aa21-6bbf1ad7d64a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.151731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887c599-11c3-4f57-aa21-6bbf1ad7d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.152003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887c599-11c3-4f57-aa21-6bbf1ad7d64a None admin] PATH_INFO: `/v3/users/bc06995ec9d94cd99d495d4159205881` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.165567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887c599-11c3-4f57-aa21-6bbf1ad7d64a None admin] RBAC: Authorizing `identity:get_user(user_id=bc06995ec9d94cd99d495d4159205881)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.166783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.167118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887c599-11c3-4f57-aa21-6bbf1ad7d64a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.168823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 163/307] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/users/bc06995ec9d94cd99d495d4159205881 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.170072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.170348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.170655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.196758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:10.197953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:10.211145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.239264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7e3ab-a1d7-4bb2-87d3-48dbbaca593a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.265025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 164/308] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:10.265995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.277334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.278136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.278412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.278675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] PATH_INFO: `/v3/system/users/e9357d5dd6ba4801ae53e2471b44a32e/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.280079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e9357d5dd6ba4801ae53e2471b44a32e, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.281521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.291809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 145/309] 10.222.0.65 () {58 vars in 1334 bytes} [Tue Sep 13 19:44:10 2022] PUT /identity/v3/system/users/e9357d5dd6ba4801ae53e2471b44a32e/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:44:10.292487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.392672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c2f4-874e-4089-980f-ca83c6f4ffaa None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.432820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.436255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.437284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.437544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d146b-4ac9-4ff1-ab7e-f057ef97bddc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.438097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.438490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.439488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] RBAC: Adding query filter params (role.id=e15766d617984ae3bbe12b81d0c1a1fe, user.id=bc06995ec9d94cd99d495d4159205881, scope.system=all) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:10.440005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.441749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.449707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 165/310] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/role_assignments?user.id=bc06995ec9d94cd99d495d4159205881&scope.system=all&role.id=e15766d617984ae3bbe12b81d0c1a1fe => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.486758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.487512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.487849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.488200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.489570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.491138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.493163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 146/311] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.498662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.524948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.580495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.614880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fdafc-9fdb-44fc-939c-4bf4c7dcefc0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.666157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.667796 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.668414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.669801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] PATH_INFO: `/v3/groups` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.671919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.674023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.695574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f4b5-e95f-41f0-953b-80866a003be1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.696726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 166/312] 10.222.0.65 () {60 vars in 1134 bytes} [Tue Sep 13 19:44:10 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:10.740350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.741310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.741745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.742143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.754537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:10.760419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:10.761582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:10.762539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:10.764939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 147/313] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:10.773997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.857830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.892779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ad26c-b7c0-427c-b161-a111ffc68403 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.927514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.928356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.928808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.929250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.930052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:10.930482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.931973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.941519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 167/314] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.946938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.975986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.050463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211f54-886f-42bb-a616-25e705c6cb9a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.088855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.090176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.090855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.091531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] PATH_INFO: `/v3/users/4ad41ea0304f4c189a912680cdbae466` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.093527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad41ea0304f4c189a912680cdbae466)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.095175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.097284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 148/315] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/users/4ad41ea0304f4c189a912680cdbae466 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:11.108652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.211004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff227a-017a-497f-b6df-9b5b0a9f0b7e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.249101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.249782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.250059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.250329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.252971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.318663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.320116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.424755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 168/316] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:11.432631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.525339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.532306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ee23-a6dd-4786-a151-200af87fe085 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.566216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38627c90-7db6-4879-8f98-b3db09cb41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.566850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38627c90-7db6-4879-8f98-b3db09cb41b8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.567123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38627c90-7db6-4879-8f98-b3db09cb41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.567387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38627c90-7db6-4879-8f98-b3db09cb41b8 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.568481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38627c90-7db6-4879-8f98-b3db09cb41b8 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.569996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38627c90-7db6-4879-8f98-b3db09cb41b8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.571921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 149/317] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:11.578797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.614464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.680897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501676e9-b129-47ae-9e90-584eb7a15da5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.717541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.718148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.718448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.718714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.719436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] RBAC: Adding query filter params (role.id=e15766d617984ae3bbe12b81d0c1a1fe, scope.project.id=c710741c8a7d4e1c97de76102643ced7, user.id=4ad41ea0304f4c189a912680cdbae466) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:11.719735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.721202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb881e11-5619-4038-a6ec-e61cd2174504 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.727573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 169/318] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/role_assignments?user.id=4ad41ea0304f4c189a912680cdbae466&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=e15766d617984ae3bbe12b81d0c1a1fe => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:12.505563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27edfd-8852-43a1-b442-11729af762f8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.506097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27edfd-8852-43a1-b442-11729af762f8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.506097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27edfd-8852-43a1-b442-11729af762f8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.507608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 150/319] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:12.512942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436060-0255-4f09-8038-af550476faa4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.513381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436060-0255-4f09-8038-af550476faa4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.513455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1436060-0255-4f09-8038-af550476faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.532607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a1436060-0255-4f09-8038-af550476faa4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:12.533825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a1436060-0255-4f09-8038-af550476faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:12.609097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 170/320] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:12.662936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43be27-e414-4dad-96c2-2900d2706073 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.663254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43be27-e414-4dad-96c2-2900d2706073 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.663476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43be27-e414-4dad-96c2-2900d2706073 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.665006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 151/321] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:12.670049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b695c9-e1ba-43cf-a1f3-f663ea6d0b10 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.670335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b695c9-e1ba-43cf-a1f3-f663ea6d0b10 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.670603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b695c9-e1ba-43cf-a1f3-f663ea6d0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.689400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-29b695c9-e1ba-43cf-a1f3-f663ea6d0b10 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:12.690584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-29b695c9-e1ba-43cf-a1f3-f663ea6d0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:12.713840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:12.760114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 171/322] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:12.875660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43be27-e414-4dad-96c2-2900d2706073 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.950007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3b2d-6240-408e-b12d-b22343ee1821 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.950339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3b2d-6240-408e-b12d-b22343ee1821 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.950532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce3b2d-6240-408e-b12d-b22343ee1821 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.952125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 172/323] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:12.957136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.957409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.957687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.976275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:12.977413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:12.979442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43be27-e414-4dad-96c2-2900d2706073 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.012632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.013272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.013546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.013808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.024275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:13.029121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.030282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 152/324] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.031376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.051701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 173/325] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:13.052541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.058108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.140726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc1fd-e483-494a-8ac1-8f7f5b3fc343 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.146328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.159368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc4d1-d6ca-42a4-a0c3-74a563b37405 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.178001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.178650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.178924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.179187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.189413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:13.194662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.195522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:13.196311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 153/326] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.197752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.198357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.198633 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.198896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.199552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.199846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.201483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.201579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.210716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 174/327] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.216208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.287065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.307830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d12b-d3f3-4fe3-814b-3211d654baaa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.318352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4af878-d824-4783-862d-6173d84aca39 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.341603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.342216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.342492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.342759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.343446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.343742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.345173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.351072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.351693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.351961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.352223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] PATH_INFO: `/v3/users/e9357d5dd6ba4801ae53e2471b44a32e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.357340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 154/328] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.357509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] RBAC: Authorizing `identity:get_user(user_id=e9357d5dd6ba4801ae53e2471b44a32e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.357606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.357690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.357690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 175/329] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/users/e9357d5dd6ba4801ae53e2471b44a32e => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:13.362446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.380639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.462923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef421e7-d75d-4c04-87b7-a38dd95c5992 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.470925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517796a0-eedf-4904-be62-6c9a34803428 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.495516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.496145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.496422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.496719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.497814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.499246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.501505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 155/330] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.502045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.508018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.508712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.508994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.509264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] PATH_INFO: `/v3/users/bc06995ec9d94cd99d495d4159205881` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.510384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=bc06995ec9d94cd99d495d4159205881)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.511818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.513406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 176/331] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/users/bc06995ec9d94cd99d495d4159205881 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.514129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.519075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.596965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.603076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282d6d-a665-4ad6-a1ed-697dc9725976 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.612350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4aa231-00c7-4e70-82ce-f32b08ef7ec5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.636583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.637226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.637504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.637772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.638494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] RBAC: Adding query filter params (role.id=179c8295939541c3816444f2b7a59ae4, user.id=e9357d5dd6ba4801ae53e2471b44a32e, scope.system=all) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.638796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.640250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.645363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffc659-d0f8-4ca3-a753-bf75f23c603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.645964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc659-d0f8-4ca3-a753-bf75f23c603c None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.646244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc659-d0f8-4ca3-a753-bf75f23c603c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.646512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffc659-d0f8-4ca3-a753-bf75f23c603c None admin] PATH_INFO: `/v3/groups` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.647139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffc659-d0f8-4ca3-a753-bf75f23c603c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.648549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffc659-d0f8-4ca3-a753-bf75f23c603c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.651504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 156/332] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/role_assignments?user.id=e9357d5dd6ba4801ae53e2471b44a32e&scope.system=all&role.id=179c8295939541c3816444f2b7a59ae4 => generated 510 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.652263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.665722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 177/333] 10.222.0.65 () {60 vars in 1134 bytes} [Tue Sep 13 19:44:13 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:13.741204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.782501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3e26e-9247-4db7-8b0c-327fe2896cf7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.833808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec3053-040d-4996-aec3-f394dc0e31e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.834492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3053-040d-4996-aec3-f394dc0e31e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.834787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3053-040d-4996-aec3-f394dc0e31e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.835146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec3053-040d-4996-aec3-f394dc0e31e8 None admin] PATH_INFO: `/v3/system/users/bc06995ec9d94cd99d495d4159205881/roles/e15766d617984ae3bbe12b81d0c1a1fe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.836758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec3053-040d-4996-aec3-f394dc0e31e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bc06995ec9d94cd99d495d4159205881, role_id=e15766d617984ae3bbe12b81d0c1a1fe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.838251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec3053-040d-4996-aec3-f394dc0e31e8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.848044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 157/334] 10.222.0.65 () {58 vars in 1334 bytes} [Tue Sep 13 19:44:13 2022] PUT /identity/v3/system/users/bc06995ec9d94cd99d495d4159205881/roles/e15766d617984ae3bbe12b81d0c1a1fe => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:16.232110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437025d3-873b-4988-842d-a5c7e57511f8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.232700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437025d3-873b-4988-842d-a5c7e57511f8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.232977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437025d3-873b-4988-842d-a5c7e57511f8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.234863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 178/335] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:16.240650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6a24c-ff22-4571-8681-1f2e73c34525 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.241083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6a24c-ff22-4571-8681-1f2e73c34525 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.241198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6a24c-ff22-4571-8681-1f2e73c34525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.267318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-80e6a24c-ff22-4571-8681-1f2e73c34525 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:16.268681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80e6a24c-ff22-4571-8681-1f2e73c34525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:16.358642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 158/336] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:16.514595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4980-4ca0-4e05-b595-d9176b45aa64 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.514941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4980-4ca0-4e05-b595-d9176b45aa64 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.515147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4980-4ca0-4e05-b595-d9176b45aa64 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.516751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 179/337] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:16.522294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1600498-e308-4792-9a08-078903de8285 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.522803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1600498-e308-4792-9a08-078903de8285 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.523288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1600498-e308-4792-9a08-078903de8285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.545336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c1600498-e308-4792-9a08-078903de8285 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:16.546883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c1600498-e308-4792-9a08-078903de8285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:16.616011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.628925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 159/338] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:16.757298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4980-4ca0-4e05-b595-d9176b45aa64 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.890629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4980-4ca0-4e05-b595-d9176b45aa64 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.940569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.941247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.941526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.941798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.945943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6530f0-9a2f-4383-a409-2eddb6cbd58e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.946458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6530f0-9a2f-4383-a409-2eddb6cbd58e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.946931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6530f0-9a2f-4383-a409-2eddb6cbd58e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.952283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 160/339] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:16.956238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:16.956784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3e58-d58c-46a7-89e7-69445e1fb219 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.957260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3e58-d58c-46a7-89e7-69445e1fb219 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.957717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3e58-d58c-46a7-89e7-69445e1fb219 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.959424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 161/340] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:16.964683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:16.965595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:44:16.966386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:16.966982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130000c-3af5-47b7-9e66-750893c44f7c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.966982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130000c-3af5-47b7-9e66-750893c44f7c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.966982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130000c-3af5-47b7-9e66-750893c44f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.967158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 180/341] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:16.968516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.984370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.005677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2130000c-3af5-47b7-9e66-750893c44f7c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:17.006882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2130000c-3af5-47b7-9e66-750893c44f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:17.133994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 162/342] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:17.135269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.135552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.135821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.150605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45fded-a807-40f0-91f1-dbae240ccd26 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.166921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:17.168435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:17.220500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.221155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.221432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.221701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.222373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:17.222671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.224063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.247017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 181/343] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:17.247872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.303442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 163/344] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:17.304313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.341306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.395804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab4886-ab3d-4d28-be5a-d15f9e895c73 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.398822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.435201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.435788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.436057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.436334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.447610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:17.453137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:17.454124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:17.454914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 182/345] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:17.461384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.505950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55cbea-f336-46e6-9067-da53fb9beb98 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.569786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb126-23aa-4afa-94ad-f4290cf835ac None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.582995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.583986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.584445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.584918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] PATH_INFO: `/v3/users/bc06995ec9d94cd99d495d4159205881` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.589318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] RBAC: Authorizing `identity:get_user(user_id=bc06995ec9d94cd99d495d4159205881)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.591028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.592931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 164/346] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/users/bc06995ec9d94cd99d495d4159205881 => generated 293 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:17.604806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.613242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.614090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.614554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.615043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.615725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:17.616077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.617502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.620666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.627617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 183/347] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:17.630927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.762325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d3f02-8377-43e4-a921-7055d17f518c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.781692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0643aa-63bb-493d-9329-9d64a43ada8c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.788542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.802842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.803532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.803808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.804076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.815107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:17.821864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:17.822761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 165/348] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:17.823567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.824337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.824966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.824966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.825226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.828054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] RBAC: Adding query filter params (role.id=e15766d617984ae3bbe12b81d0c1a1fe, user.id=bc06995ec9d94cd99d495d4159205881, scope.system=all) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:17.828054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.828054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.840084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 184/349] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/role_assignments?user.id=bc06995ec9d94cd99d495d4159205881&scope.system=all&role.id=e15766d617984ae3bbe12b81d0c1a1fe => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:17.845662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.909759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.947643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19eadb-8b91-4c98-884f-3601539c2055 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.973820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f731-d1c0-4a9f-bc34-93e35d11df6a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.997631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.998637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.999083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.999522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.012916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c420f-c2f8-442a-b2ee-7159c34ebc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.013616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c420f-c2f8-442a-b2ee-7159c34ebc75 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.014220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c420f-c2f8-442a-b2ee-7159c34ebc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.014326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c420f-c2f8-442a-b2ee-7159c34ebc75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.027336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c420f-c2f8-442a-b2ee-7159c34ebc75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c24c420f-c2f8-442a-b2ee-7159c34ebc75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:18.033760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:18.034738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:18.035509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 185/350] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:18.041317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef644-1a6f-4e6a-834c-4c9f77b4564e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.041664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef644-1a6f-4e6a-834c-4c9f77b4564e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.042001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ef644-1a6f-4e6a-834c-4c9f77b4564e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.043862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 186/351] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:18.045116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef644-1a6f-4e6a-834c-4c9f77b4564e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.063589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.089524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.091360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.170822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ef644-1a6f-4e6a-834c-4c9f77b4564e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.180824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.213984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 166/352] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:18.215156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.217998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.219051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.219331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.219596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.220274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] RBAC: Adding query filter params (name=member) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:18.220570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.221991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c50b1-fa57-4460-b1f9-a6a48579c227 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.233047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 187/353] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.234428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.234747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.235015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.259453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:18.262420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:18.330097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.342562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 188/354] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:18.343219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.355245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dfd69-55d7-4ef8-a2b0-ebd714a06a81 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.408207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.408851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.409122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.409391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.410066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:18.410361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.411729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.425572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 167/355] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.426258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.463136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.466846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1db2e-bdbd-4daf-a3e1-16532923bc57 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.524673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.528553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.529192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.529693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.531244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.533520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.535940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 189/356] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.536915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.577482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d000-3e9d-4ead-ab9d-ab6b5a6e9fd3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.619711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.620732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.621193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.621762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.640154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.664294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82f7e0-689a-45c9-bf67-d4fb477aaf25 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.702074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c1d97-cccf-4c76-afa1-ce53f3b3bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.702662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.702876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c1d97-cccf-4c76-afa1-ce53f3b3bced None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.703073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c1d97-cccf-4c76-afa1-ce53f3b3bced None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.703320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c1d97-cccf-4c76-afa1-ce53f3b3bced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.704209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.742088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.783076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c1d97-cccf-4c76-afa1-ce53f3b3bced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.784925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c1d97-cccf-4c76-afa1-ce53f3b3bced None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.821058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 168/357] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:18.821929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.874545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.908652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 190/358] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:18.908652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e426a1-a0c3-4188-a219-81c1d5000eaa None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.908652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e426a1-a0c3-4188-a219-81c1d5000eaa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.908652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e426a1-a0c3-4188-a219-81c1d5000eaa None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.908652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 191/359] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:18.909082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e426a1-a0c3-4188-a219-81c1d5000eaa None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.940539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02b641-9bb2-458d-9ec7-fc9dc8afb579 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.986363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.987015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.987291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.987562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.993351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.994243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.995634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.997847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 169/360] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.998196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.040357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e426a1-a0c3-4188-a219-81c1d5000eaa None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.084386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.085063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.085551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.085677 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.098171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:19.103288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:19.104169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:19.104994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 192/361] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:19.106106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.116270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cffed-283f-4c99-bd48-42c75e5f7e67 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.126136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.153772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f5ac6-c1dd-4428-a97f-10ff60200675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.154420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f5ac6-c1dd-4428-a97f-10ff60200675 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.154698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f5ac6-c1dd-4428-a97f-10ff60200675 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.154963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f5ac6-c1dd-4428-a97f-10ff60200675 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.156138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f5ac6-c1dd-4428-a97f-10ff60200675 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.157613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f5ac6-c1dd-4428-a97f-10ff60200675 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.159290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 170/362] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.160447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.162625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.162625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.180857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:19.182064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:19.226162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419982d3-57b3-48d8-bce3-69e52c0eda6e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.256902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.264443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 171/363] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:19.265970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.271509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.272162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.272440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.272739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.275952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.277861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.280426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 193/364] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.281289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.398804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c1534-ac76-4f15-85e9-3911a82e2b11 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.407328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.421672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eea869-d5ca-464d-b143-44e9d2af9666 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.451068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.451905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.452328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.452762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.453712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:19.454158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.455757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.461184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.461730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.462005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.462265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.462978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:19.463273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.464653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.468985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 172/365] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=179c8295939541c3816444f2b7a59ae4 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.470273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.474080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 194/366] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.475427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.548135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.611614 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c1ccd-59af-4f4a-8acb-a459f749fa73 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.612010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17be79-c779-4d25-b157-764c3c29954c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.657874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.658456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.658731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.659001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.659846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.660100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.660525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.660836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.661109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.662009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.664569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.664710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 173/367] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.664710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.664855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.666507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 195/368] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.667279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.715449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.790518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33458ea2-cbec-4e77-aa7e-064dd9439942 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.797867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584f7b-15d7-4158-98ba-d288d23243f9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.822768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.833654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.834395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.834680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.834951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.845365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.845987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.846304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.846578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.847585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:19.855357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:19.856267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:19.857204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:19.858384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 196/369] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:19.858551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.927645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.927645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.970133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.989499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff204b-ddd3-4c9d-a947-462ce06abf46 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.031165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.031790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.032069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.032337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.033300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=c710741c8a7d4e1c97de76102643ced7) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.033609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.035650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.043256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 197/370] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=179c8295939541c3816444f2b7a59ae4 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.044103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.044558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 174/371] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:20.045501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.112412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.189634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8eb83-8e06-4ffb-898d-99f36a68cc17 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.199115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf358-3ef8-4f64-a4e9-b4e44b98c16b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.232121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.232813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.233097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.233361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.234032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.234373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.238881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.246714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.251434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.252859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.253207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.253545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.254298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.254613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.256084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.256846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 175/372] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.258934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.264077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 198/373] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.264892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.439360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1fb93-970e-4e07-a2c6-75090b983cea None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.451991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be44d1-a064-4bc6-8b44-9d7a1dadded0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.476028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.508406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.509036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.509313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.509579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.511027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.512494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.514323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 176/374] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.518068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.519088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.519545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.519988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.521872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.632152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.634025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.658753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.730761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e5c32-8ce2-40dd-b521-71938d1dd351 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.800752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.801397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.801675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.801946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.803618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.805092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.806847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 177/375] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.814329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.816733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 199/376] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:20.825686 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.851640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.943503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24027c-9223-45bc-b8d5-be4e4b48882c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.986729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.987254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.987590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.987866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.988592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=c710741c8a7d4e1c97de76102643ced7) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.988919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.990364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.999598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.005312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 178/377] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.032518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aea2e1-d654-4356-b95f-c2d1bbf40957 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.070642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.071657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.072138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.072643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] PATH_INFO: `/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.074616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] RBAC: Authorizing `identity:get_project(project_id=23d0b7aaf7cd4805b724aaf6b19401b4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.077318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.079974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 200/378] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4 => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.087013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.216112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15230131-820c-4ecf-8f47-92e8d64a76dd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.253120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09c2c-026e-46b4-857a-709fca13715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.253777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09c2c-026e-46b4-857a-709fca13715c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.254050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09c2c-026e-46b4-857a-709fca13715c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.254317 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09c2c-026e-46b4-857a-709fca13715c None admin] PATH_INFO: `/v3/groups/cd28afab20384fb1a1bed053a9dddd98` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.260091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09c2c-026e-46b4-857a-709fca13715c None admin] RBAC: Authorizing `identity:get_group(group_id=cd28afab20384fb1a1bed053a9dddd98)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.261607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09c2c-026e-46b4-857a-709fca13715c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.263550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 179/379] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/groups/cd28afab20384fb1a1bed053a9dddd98 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.269201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.370715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.397786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d6086-35bd-4e07-9881-fdcd1376b3ca None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.441946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.442578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.442866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.443135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.443938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] RBAC: Adding query filter params (group.id=cd28afab20384fb1a1bed053a9dddd98, role.id=ff6687245616423c8a3e42542a544932, scope.project.id=23d0b7aaf7cd4805b724aaf6b19401b4) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.444250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.445765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18153ca4-4fc6-49eb-b92b-dba04d4f6ac3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.455453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 201/380] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/role_assignments?group.id=cd28afab20384fb1a1bed053a9dddd98&scope.project.id=23d0b7aaf7cd4805b724aaf6b19401b4&role.id=ff6687245616423c8a3e42542a544932 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.921285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1abea-8916-48e7-a754-0270ba3606a7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.922050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1abea-8916-48e7-a754-0270ba3606a7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.922050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1abea-8916-48e7-a754-0270ba3606a7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.923407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 180/381] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:21.933890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b523-d3a0-42d0-b486-8939b2e55e4a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.934175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b523-d3a0-42d0-b486-8939b2e55e4a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.934451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b523-d3a0-42d0-b486-8939b2e55e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.959293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3367b523-d3a0-42d0-b486-8939b2e55e4a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:21.960553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3367b523-d3a0-42d0-b486-8939b2e55e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:22.059354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 202/382] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:22.454008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1abea-8916-48e7-a754-0270ba3606a7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.546255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.574046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bcc86-d9e1-4a3b-8a98-661751dc5bc2 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.574701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bcc86-d9e1-4a3b-8a98-661751dc5bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.574701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bcc86-d9e1-4a3b-8a98-661751dc5bc2 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.576233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 203/383] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:22.581546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a045f-0d41-441c-87ca-5793903a4f5f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.582052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a045f-0d41-441c-87ca-5793903a4f5f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.582526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a045f-0d41-441c-87ca-5793903a4f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.601610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ea2a045f-0d41-441c-87ca-5793903a4f5f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:22.603173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea2a045f-0d41-441c-87ca-5793903a4f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:22.605490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1abea-8916-48e7-a754-0270ba3606a7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.679014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.679720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.680002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.680270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.694855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:22.700513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:22.701544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:22.702357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:22.704765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 181/384] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:22.708456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.742041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 204/385] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:22.851309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831ed1-bdd1-416a-9696-85a904cd3667 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.851602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831ed1-bdd1-416a-9696-85a904cd3667 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.851863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65831ed1-bdd1-416a-9696-85a904cd3667 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.853097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e695b-39d1-41fb-987d-6b3f8c17da90 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.853554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 205/386] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:22.858808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.859121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.859422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.884875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.886329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:22.887975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:22.896106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.910269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.910905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.911181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.911453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.912117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:22.913171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.914783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.932789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 182/387] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:22.939481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.989921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 206/388] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:23.072505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926c0ec-9af9-4b80-96e2-70d4fdc18d71 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.075598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.107968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.108603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.108902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.109270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.110412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.112278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.118208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 183/389] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.121881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.184769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.222236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d8463-d4a3-4d40-9a4b-974e857546fc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.226270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05971ffb-904a-4c41-91b3-4dbe269f0755 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.265230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.265925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.266210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.266472 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.267306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.267998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.268278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.268580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.269944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.271450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.272276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.273588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 184/390] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.279826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.292393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:23.299055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:23.299920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:23.301369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 207/391] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:23.306134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.420966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af8862-7a5b-48ad-9edb-784d33c2f5cd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.441903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e0d3c-2886-4784-83ca-e58efac79a11 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.444351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.458353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.459363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.459855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.460333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/groups/b114ebade4224311a2d025a07620f2af/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.462475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] RBAC: Authorizing `identity:create_grant(project_id=9887ccb4f90f4b25bc965506f3b262a0, group_id=b114ebade4224311a2d025a07620f2af, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.464124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.480240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 185/392] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Sep 13 19:44:23 2022] PUT /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/groups/b114ebade4224311a2d025a07620f2af/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:23.481315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.483371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.484301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.484509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.484800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.485542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.486261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.487845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.498685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 208/393] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.505719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.578597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.626628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ffb2-51ff-4581-9139-cf06782bd816 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.626941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa896ae-c091-4a38-9151-d40f5efe554b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.667994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.669099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.669585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.670143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.672118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.674476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.676327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.677173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.677461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 209/394] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.677773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.678148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.688648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.711262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:23.723252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:23.724231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:23.725072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 186/395] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:23.730483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.810175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.859449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8d16f-1ad0-49e4-b7bb-c8cb2fb255e3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.888220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dbb9c-3415-4c78-88ad-83905503947d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.891333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.906391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084fc30-b63c-40ac-9c05-05094725bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.907565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fc30-b63c-40ac-9c05-05094725bea9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.908002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fc30-b63c-40ac-9c05-05094725bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.908456 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084fc30-b63c-40ac-9c05-05094725bea9 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.913400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084fc30-b63c-40ac-9c05-05094725bea9 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.915127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084fc30-b63c-40ac-9c05-05094725bea9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.917219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 210/396] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.918505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91ea0-a972-4e1f-9cd5-8f093bb9883c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.918786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91ea0-a972-4e1f-9cd5-8f093bb9883c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.919065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b91ea0-a972-4e1f-9cd5-8f093bb9883c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.924713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 211/397] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:23.925571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91ea0-a972-4e1f-9cd5-8f093bb9883c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.933856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.935123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.935583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.935980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.936850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.937332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.938974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cbef3-f182-4a05-8507-481a1459357d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.948354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 187/398] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.949920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.950393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.950788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.972900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:23.974995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:24.034189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b91ea0-a972-4e1f-9cd5-8f093bb9883c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.070389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 188/399] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:24.071840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.085925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.086835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.087270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.087690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/groups/b114ebade4224311a2d025a07620f2af/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.090096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] RBAC: Authorizing `identity:create_grant(project_id=9887ccb4f90f4b25bc965506f3b262a0, group_id=b114ebade4224311a2d025a07620f2af, role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.091683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.121381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 212/400] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Sep 13 19:44:23 2022] PUT /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0/groups/b114ebade4224311a2d025a07620f2af/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:24.129616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.205706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb000c-32da-41c6-93c3-8b9d76431b45 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.253480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a6fa8-fbb5-4142-82f0-b7636d535eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.254486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a6fa8-fbb5-4142-82f0-b7636d535eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.254901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a6fa8-fbb5-4142-82f0-b7636d535eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.255304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a6fa8-fbb5-4142-82f0-b7636d535eb7 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.261599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a6fa8-fbb5-4142-82f0-b7636d535eb7 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.263350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a6fa8-fbb5-4142-82f0-b7636d535eb7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.265216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 189/401] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.271793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.290479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cfe32-e88f-4b9a-aa6b-bb370d384830 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.290826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cfe32-e88f-4b9a-aa6b-bb370d384830 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.291020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cfe32-e88f-4b9a-aa6b-bb370d384830 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.292548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 190/402] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:24.297569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.297845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.298114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.329757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:24.330974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:24.377228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.425944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb31fb-e539-4ba5-8d0b-145a5daef587 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.429341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 191/403] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:24.436699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.464642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.475914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.477389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.477677 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.477951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.479688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.481461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.483965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 213/404] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.490679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.543071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ff896-93f9-4d3d-9203-a6330fa260df None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.587774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.589072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.589537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.590394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.607281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a6976-4b73-4491-b2ea-548b6dc5ac78 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.613487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:24.622300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:24.623175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:24.623965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:24.630793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 192/405] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:24.633092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.655427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.679501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.680203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.680476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.680775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7/groups/b114ebade4224311a2d025a07620f2af/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.689444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] RBAC: Authorizing `identity:create_grant(project_id=c710741c8a7d4e1c97de76102643ced7, group_id=b114ebade4224311a2d025a07620f2af, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.690917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.719426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 214/406] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Sep 13 19:44:24 2022] PUT /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7/groups/b114ebade4224311a2d025a07620f2af/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:24.762392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.773244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49da612-6733-444c-b205-693f31aa4a84 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.816103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.827962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.828589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.828891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.829158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.829834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:24.830145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.831551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.840816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 193/407] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:24.850386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.991710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3630d-e9b3-42bb-aeaa-75983248fbaa None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.008564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787c6c-06c7-4496-ac38-217e9e706344 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.031290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.031940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.032219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.032490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.044932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:25.047246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.048131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.048604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.049120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:25.050429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:25.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:25.052298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 215/408] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:25.053297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.054776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.056844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 194/409] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:25.057421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.066673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.108383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.120212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.173209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176110d-23d2-44e5-9c88-46015d678d90 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.226435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.227075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.227339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.227614 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.228285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:25.228661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.230064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.248494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 216/410] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:25.257895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.283981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a52e3-0c41-4777-8ff7-3a7b0846243e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.373912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.374826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.375108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.375373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.381755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.383409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.385419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 195/411] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:25.390834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.394921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bdcee-0471-4eed-a6e9-09bc1b112050 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.417076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.436510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.442283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.442573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.442849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] PATH_INFO: `/v3/groups/cd28afab20384fb1a1bed053a9dddd98` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.444156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] RBAC: Authorizing `identity:get_group(group_id=cd28afab20384fb1a1bed053a9dddd98)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.446121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.448015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 217/412] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/groups/cd28afab20384fb1a1bed053a9dddd98 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:25.456006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.585494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.604720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8132-8562-4f38-8e28-6c648e59cfc9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.646372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc81867-3742-4b59-854f-a49db4670461 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.673140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.673812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.674085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.674347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7/groups/b114ebade4224311a2d025a07620f2af/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.677661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] RBAC: Authorizing `identity:create_grant(project_id=c710741c8a7d4e1c97de76102643ced7, group_id=b114ebade4224311a2d025a07620f2af, role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.679108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.702960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b8271-b451-4255-9d18-54c0efbdbbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.703632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8271-b451-4255-9d18-54c0efbdbbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.703909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8271-b451-4255-9d18-54c0efbdbbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.704179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8271-b451-4255-9d18-54c0efbdbbe3 None admin] PATH_INFO: `/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.708129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b8271-b451-4255-9d18-54c0efbdbbe3 None admin] RBAC: Authorizing `identity:get_project(project_id=23d0b7aaf7cd4805b724aaf6b19401b4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.712402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 196/413] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Sep 13 19:44:25 2022] PUT /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7/groups/b114ebade4224311a2d025a07620f2af/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:25.713851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b8271-b451-4255-9d18-54c0efbdbbe3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.715832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 218/414] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:25.721785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.869167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f325d-b08a-4307-b281-9b351e46e53a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.918185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595bdd-a6a2-4d52-bcfd-ffc3ca6c0c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.918871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595bdd-a6a2-4d52-bcfd-ffc3ca6c0c41 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.919146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595bdd-a6a2-4d52-bcfd-ffc3ca6c0c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.919413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595bdd-a6a2-4d52-bcfd-ffc3ca6c0c41 None admin] PATH_INFO: `/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4/groups/cd28afab20384fb1a1bed053a9dddd98/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.923230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83595bdd-a6a2-4d52-bcfd-ffc3ca6c0c41 None admin] RBAC: Authorizing `identity:create_grant(project_id=23d0b7aaf7cd4805b724aaf6b19401b4, group_id=cd28afab20384fb1a1bed053a9dddd98, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.925501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83595bdd-a6a2-4d52-bcfd-ffc3ca6c0c41 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.944675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 197/415] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Sep 13 19:44:25 2022] PUT /identity/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4/groups/cd28afab20384fb1a1bed053a9dddd98/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:26.074459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50bc3-c88c-44ab-b6ad-825bdc10fe65 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.074808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50bc3-c88c-44ab-b6ad-825bdc10fe65 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.074964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c50bc3-c88c-44ab-b6ad-825bdc10fe65 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.076572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 219/416] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:26.082012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.082879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.083337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.109902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:26.111857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:26.115481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.189824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 198/417] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:26.474488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50bc3-c88c-44ab-b6ad-825bdc10fe65 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.519041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.592314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c50bc3-c88c-44ab-b6ad-825bdc10fe65 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.626609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.627257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.627535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.627805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.638528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:26.643721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:26.644639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:26.645432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:26.648312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 220/418] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:26.651234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.794279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a4bdb-d6dc-440c-8c8b-c0a9e3cda814 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.835513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.836123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.836393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.836675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.837341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:26.837634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.838981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c56ad-78f0-4243-ae9d-40284ba470c0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.852312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 199/419] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:26.857958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.010293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2862377-fa3a-482a-bed2-4088c9247e98 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.010646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2862377-fa3a-482a-bed2-4088c9247e98 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.010841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2862377-fa3a-482a-bed2-4088c9247e98 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.012429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 200/420] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:27.017798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.018075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.018333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.024668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.036505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.038876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:27.039310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70009b78-f8e7-4fb6-8340-f6ac3e909813 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.040309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:27.097944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.098483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.098764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.099036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.165746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 201/421] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:27.202293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.203803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.307304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.316734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 221/422] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:27.318951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.423504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca0157-0178-42d6-a995-f9dd23e7d44f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.468109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.479493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.488573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.490617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.491140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.491685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.493858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.495681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.502569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 202/423] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:27.505199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.606078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549481a-0c4f-44e8-8da9-0aa6fa6e4844 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.634496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aea4a-a983-4fef-b08b-ec9e39820744 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.646451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59473f-ac05-442a-b64b-40bf63da0f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.647279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59473f-ac05-442a-b64b-40bf63da0f51 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.647782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59473f-ac05-442a-b64b-40bf63da0f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.648252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59473f-ac05-442a-b64b-40bf63da0f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.659057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59473f-ac05-442a-b64b-40bf63da0f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3d59473f-ac05-442a-b64b-40bf63da0f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:27.664578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:27.665547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:27.666336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:27.668874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 222/424] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:27.670243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f622729-189f-40a9-99f5-166cc5459832 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.670715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f622729-189f-40a9-99f5-166cc5459832 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.671209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f622729-189f-40a9-99f5-166cc5459832 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.673003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 223/425] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:27.678074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f622729-189f-40a9-99f5-166cc5459832 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.681059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df7880-89d4-4a0c-8ccd-328d5977cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.681697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7880-89d4-4a0c-8ccd-328d5977cada None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.681971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7880-89d4-4a0c-8ccd-328d5977cada None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.682236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df7880-89d4-4a0c-8ccd-328d5977cada None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.684587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df7880-89d4-4a0c-8ccd-328d5977cada None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.686080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df7880-89d4-4a0c-8ccd-328d5977cada None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.688043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 203/426] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:27.689180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.689456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.689726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.713937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:27.715532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:27.746612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.792687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.798931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 204/427] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:27.804111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.808963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f622729-189f-40a9-99f5-166cc5459832 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.851817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.852430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.852728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.852997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.853661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:27.853964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.855334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.874192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 224/428] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:27.890402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.971378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b4f0-74a4-4dbf-9680-dda0812b7e09 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.009422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.010035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.010306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.010568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.011293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.011597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.013055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.026048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 205/429] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=179c8295939541c3816444f2b7a59ae4 => generated 611 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.084789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818e17d-696a-4487-ab2d-8f53e3a4fb53 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.091527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.136255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.163222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.163901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.164183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.164452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.210101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.277703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c64e-5dee-4868-bed6-027faf83caaf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.283860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.285462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.315405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.316075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.316545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.316942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.331330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:28.336355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:28.339098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:28.339887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 206/430] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:28.344409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.410943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 225/431] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:44:28.417671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.446139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.466355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14756436-a85b-4d76-a728-069428bd64d1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.493664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.508117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.508907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.508907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.509072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.509639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.509929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.511748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069d491-adf3-421f-b7fa-898982c7d3ed None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.520653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 207/432] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.521930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d807b0-10fb-4610-b1df-2290f2e93b84 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.522205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d807b0-10fb-4610-b1df-2290f2e93b84 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.522475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d807b0-10fb-4610-b1df-2290f2e93b84 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.525856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 208/433] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:28.528971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d807b0-10fb-4610-b1df-2290f2e93b84 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.553080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f368-7791-4ffb-8ab8-9ce9503e022a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.590561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79821d7-a6d5-4885-b6c0-438bb4bfda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.591207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79821d7-a6d5-4885-b6c0-438bb4bfda0c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.591628 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79821d7-a6d5-4885-b6c0-438bb4bfda0c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.591920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79821d7-a6d5-4885-b6c0-438bb4bfda0c None admin] PATH_INFO: `/v3/projects/9887ccb4f90f4b25bc965506f3b262a0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.593836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79821d7-a6d5-4885-b6c0-438bb4bfda0c None admin] RBAC: Authorizing `identity:get_project(project_id=9887ccb4f90f4b25bc965506f3b262a0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.595292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79821d7-a6d5-4885-b6c0-438bb4bfda0c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.597286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 226/434] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/projects/9887ccb4f90f4b25bc965506f3b262a0 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.598424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.598873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.599148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.622260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:28.624200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:28.652294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d807b0-10fb-4610-b1df-2290f2e93b84 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.691555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.691971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.692245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.692547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.709281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 227/435] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:28.710815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.736389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.753784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.773750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.775209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.823944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3d1b-2d7f-419d-a440-34b9d9e31ea7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.862530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320b4a0-6d8c-4a00-bc90-bcc27e6cd5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.863529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320b4a0-6d8c-4a00-bc90-bcc27e6cd5fd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.864120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320b4a0-6d8c-4a00-bc90-bcc27e6cd5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.864461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320b4a0-6d8c-4a00-bc90-bcc27e6cd5fd None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.865609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320b4a0-6d8c-4a00-bc90-bcc27e6cd5fd None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.867988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320b4a0-6d8c-4a00-bc90-bcc27e6cd5fd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.874753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 228/436] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.874753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace15e83-c488-4032-9e76-c34e915bf469 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.874753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace15e83-c488-4032-9e76-c34e915bf469 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.874753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace15e83-c488-4032-9e76-c34e915bf469 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.875105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 209/437] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:44:28.875868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.876731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 229/438] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:28.877869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace15e83-c488-4032-9e76-c34e915bf469 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.966187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.967969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.982211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace15e83-c488-4032-9e76-c34e915bf469 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.984494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04420c1-b5b9-4437-8572-12ca992000ea None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.016729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a9e19-3937-4e80-9053-087a07f7861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.017365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9e19-3937-4e80-9053-087a07f7861d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.017645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9e19-3937-4e80-9053-087a07f7861d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.017848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.017951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a9e19-3937-4e80-9053-087a07f7861d None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.018444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.018752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.019012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.019139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9e19-3937-4e80-9053-087a07f7861d None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.019717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=9887ccb4f90f4b25bc965506f3b262a0) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:29.020028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.020467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a9e19-3937-4e80-9053-087a07f7861d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.021455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.022102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 230/439] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:29.023432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.023720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.024448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.027132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 210/440] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=9887ccb4f90f4b25bc965506f3b262a0&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:29.027900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.043616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:29.044888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:29.120150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 231/441] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:29.120994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.174522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b78409-4667-4369-8f17-8eb73a2310bd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.216525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.217332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.217533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.217796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.229666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:29.231503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:29.234997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:29.236418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:29.237219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 211/442] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:29.243059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.253560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce164-06b5-4027-b5ae-703af4487f75 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.255325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.293441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.294080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.294358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.294628 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.295741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.297574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.300746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 232/443] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:29.306096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.364843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c0e83-4a06-414c-88e9-e88c246020e7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.414992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.415531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.415805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.416076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.416771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:29.417070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.418997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.431477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 212/444] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:29.431477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.446742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8c6c-0586-4dde-81b7-01500732c079 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.484541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.485181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.485460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.485727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.486817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=179c8295939541c3816444f2b7a59ae4, scope.project.id=c710741c8a7d4e1c97de76102643ced7) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:29.487122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.488547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.495624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 233/445] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=179c8295939541c3816444f2b7a59ae4 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:29.496422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.516260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.526513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.561643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0213-f556-4d6b-b0f3-df64ea073b5b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.598053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.598695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.598967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.599230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.612001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:29.612529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d4c96-3c6d-437f-aa5a-6cd39062eef0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:29.617377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:29.618324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:29.621502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 213/446] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:29.624457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.653741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.654371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.654653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.654929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.733189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.735097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.746242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8738b-1686-4188-bf03-7c9bdfcd2dfc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.756989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.778626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.787582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.788193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.788575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.788865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.792666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:29.792666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.792666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.800785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 214/447] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:29.806511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.856571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 234/448] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:29.863057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:29.925185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1460-2e0b-4f74-99d7-8704cc0fb408 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.958617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.959224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.959499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.959762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.964360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715752-aab1-48ea-9671-0b61b1f1411b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.983389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.000436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.001098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.001371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.001636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] PATH_INFO: `/v3/projects/c710741c8a7d4e1c97de76102643ced7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.002770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] RBAC: Authorizing `identity:get_project(project_id=c710741c8a7d4e1c97de76102643ced7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.004218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.005892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 235/449] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/projects/c710741c8a7d4e1c97de76102643ced7 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:30.011549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.017433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.027179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.028741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.110601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5bbf5-01cf-4379-9822-8e09ac2ec757 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.127804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 215/450] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:44:30.133566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.144253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.144927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.145205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.145474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] PATH_INFO: `/v3/groups/b114ebade4224311a2d025a07620f2af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.146707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] RBAC: Authorizing `identity:get_group(group_id=b114ebade4224311a2d025a07620f2af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.148208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.154659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 236/451] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/groups/b114ebade4224311a2d025a07620f2af => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:30.155639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.209267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.223996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.233641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb173-5393-4bf8-a096-5140fa1a1671 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.254373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f5766-8cba-44af-b478-8fd145966f71 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.269021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.269671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.269939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.270189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] PATH_INFO: `/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.271403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] RBAC: Authorizing `identity:get_project(project_id=23d0b7aaf7cd4805b724aaf6b19401b4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.272891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.274664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 216/452] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/projects/23d0b7aaf7cd4805b724aaf6b19401b4 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:30.280053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.288897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.289514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.289793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.290061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.290785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] RBAC: Adding query filter params (group.id=b114ebade4224311a2d025a07620f2af, role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=c710741c8a7d4e1c97de76102643ced7) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:30.291092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.292516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.298364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 237/453] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/role_assignments?group.id=b114ebade4224311a2d025a07620f2af&scope.project.id=c710741c8a7d4e1c97de76102643ced7&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:30.387571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4187-5e6e-4ac0-befe-c75ff9cee872 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.425280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc3034-a940-4b98-8640-e8691914843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.425945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3034-a940-4b98-8640-e8691914843d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.426222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3034-a940-4b98-8640-e8691914843d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.426492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc3034-a940-4b98-8640-e8691914843d None admin] PATH_INFO: `/v3/groups/cd28afab20384fb1a1bed053a9dddd98` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.427712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc3034-a940-4b98-8640-e8691914843d None admin] RBAC: Authorizing `identity:get_group(group_id=cd28afab20384fb1a1bed053a9dddd98)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.429242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc3034-a940-4b98-8640-e8691914843d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.430859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 217/454] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/groups/cd28afab20384fb1a1bed053a9dddd98 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:30.437041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.539677 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd350d0a-551f-42f5-afb0-60d2e368663e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.556853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.573458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.574067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.574371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.574612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.575337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] RBAC: Adding query filter params (group.id=cd28afab20384fb1a1bed053a9dddd98, role.id=ff6687245616423c8a3e42542a544932, scope.project.id=23d0b7aaf7cd4805b724aaf6b19401b4) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:30.575654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.577131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf2d54-42ee-45d0-8f7d-5a1acd09677a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.583148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 238/455] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/role_assignments?group.id=cd28afab20384fb1a1bed053a9dddd98&scope.project.id=23d0b7aaf7cd4805b724aaf6b19401b4&role.id=ff6687245616423c8a3e42542a544932 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.069389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f0195-8902-4ee5-aa13-040bc9730465 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.069918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f0195-8902-4ee5-aa13-040bc9730465 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.069918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f0195-8902-4ee5-aa13-040bc9730465 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.071459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 218/456] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:33.076896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68578a-10c8-448b-9c7d-62deb12ecac8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.077327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68578a-10c8-448b-9c7d-62deb12ecac8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.077418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68578a-10c8-448b-9c7d-62deb12ecac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.100865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5a68578a-10c8-448b-9c7d-62deb12ecac8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:33.102091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5a68578a-10c8-448b-9c7d-62deb12ecac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:33.195404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 239/457] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:33.285579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415519c-b528-473c-a4ca-88f0712b04a1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.285908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415519c-b528-473c-a4ca-88f0712b04a1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.286120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415519c-b528-473c-a4ca-88f0712b04a1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.287693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 219/458] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:33.293047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922e415-633a-4ea5-97e6-20226d76d413 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.293329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922e415-633a-4ea5-97e6-20226d76d413 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.293604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922e415-633a-4ea5-97e6-20226d76d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.326086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0922e415-633a-4ea5-97e6-20226d76d413 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:33.327239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0922e415-633a-4ea5-97e6-20226d76d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:33.414917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 240/459] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:33.460763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293029-e0dc-438b-8bc3-2615b36e9bb2 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.461336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293029-e0dc-438b-8bc3-2615b36e9bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.461798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293029-e0dc-438b-8bc3-2615b36e9bb2 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.463594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 220/460] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:33.468533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.468875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.469145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.495322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:33.496496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:33.536327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.567140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc293029-e0dc-438b-8bc3-2615b36e9bb2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.580046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 241/461] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:33.619778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.716319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc293029-e0dc-438b-8bc3-2615b36e9bb2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.763592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.764229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.764508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.764802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.780418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.781978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:33.803776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:33.804753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:33.805592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:33.805592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:33.805592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:33.805592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 221/462] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:33.812088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.836426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.945350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e29be0-2900-4d37-a88b-5abf46378ba5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.966958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.980720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.981318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.981596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.981867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.982513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:33.982839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.984170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.994818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1310-862e-453a-9009-ca90b2e365d9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.996606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 242/463] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.997516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.032689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.039051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.039687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.040013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.040448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.052448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.054168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:34.072311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:34.073665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:34.074497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:34.074497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.074497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:34.076511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 222/464] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:34.077608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.118237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf66621-ade4-4257-b213-5ed1b0713a39 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.155051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.156044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.156556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.157055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.169407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.171117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:34.187722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:34.188689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:34.189627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:34.189627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.189627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:34.190671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 243/465] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:34.192141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.205961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7715f-875f-4027-8b30-d90b11ca96d4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.240306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.246557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.247264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.247534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.247798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.248431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.250272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.276807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 223/466] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:34 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:34.277727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.285046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.298894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18baf-9a7d-4ab0-8900-1c3c6dbeb833 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.341805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.342777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.343060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.343330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.344455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:34.344793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.347232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40670d58-55eb-444a-a3e1-d125d778fc2e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.365534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 244/467] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:34.367104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08979c-f587-49a8-9ad5-fb78d30a5b50 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.367490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08979c-f587-49a8-9ad5-fb78d30a5b50 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.367860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08979c-f587-49a8-9ad5-fb78d30a5b50 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.373973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 245/468] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:34.375444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.375829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.376194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.402930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:34.404624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:34.419763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec138c3-c652-4d91-a656-f54a33a48543 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.457669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.458439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.458811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.459175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.459929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:34.460324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.461861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.481571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 224/469] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:34.482555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.496961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 246/470] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:34.498024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.536683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.587565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.608860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460fa15-2fda-4260-8501-f5b9c1f8e14c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.617581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cbfc7-b07a-434a-b6d0-2bc24337c0f1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.651869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.652780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.653204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.653612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.654403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.656022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.656855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525838-7ac4-439d-bf55-c34506350e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.657473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525838-7ac4-439d-bf55-c34506350e05 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.657748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525838-7ac4-439d-bf55-c34506350e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.658015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525838-7ac4-439d-bf55-c34506350e05 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.658660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d525838-7ac4-439d-bf55-c34506350e05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.660076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d525838-7ac4-439d-bf55-c34506350e05 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.682960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 225/471] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:34 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:34.695936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 247/472] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:34 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:34.818202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.945691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b0002-6086-40f9-ae7b-69aa11b9b169 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.945882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b0002-6086-40f9-ae7b-69aa11b9b169 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.946138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b0002-6086-40f9-ae7b-69aa11b9b169 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.947733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 248/473] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:34.954056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.954377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.954600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.970107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247cd44-ccf2-43fc-b0e0-ff440de7f0d2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.973795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.976556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:34.979001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:35.013501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.014241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.014588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.014855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.027148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.028658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:35.045695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:35.046873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:35.047945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:35.047945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:35.047945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:35.047945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 226/474] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:35.053500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.062853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 249/475] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:35.168767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f9a7f-4e35-4cc6-b730-755706e390a2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.220446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.220996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.221273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.221543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.222185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.222481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.223861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.243541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 227/476] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:35.249407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.335898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.382644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0912-e583-4182-a0b9-5b43ecb77be2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.405382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.417793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.418756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.419225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.419697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.420546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.422281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.450703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.470012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 250/477] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:35 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:35.566703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b9e49-fd4f-406d-8f1a-058ce091c13a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.610158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.610785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.611458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.611720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.612407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.613833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.623409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.sql.core [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:44:35.623409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:44:35.623409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [parameters: {'id': 'ea186bd0f8824cb0a2b8976e09355841', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:44:35.623409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81564) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:35.641211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:35.642161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application yield resource Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise self.value Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application session.commit() Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:44:35.643148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:44:35.644003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:35.644943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:35.645746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [parameters: {'id': 'ea186bd0f8824cb0a2b8976e09355841', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:35.646519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:44:35.647316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:35.648153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 228/478] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Sep 13 19:44:35 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:35.655588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.765194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8e33-a79d-4f3e-950d-598a29b20ad6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.782940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.802513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043bab1-48bf-4d3e-b725-dbb0a6fa92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.803205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043bab1-48bf-4d3e-b725-dbb0a6fa92ae None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.803476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043bab1-48bf-4d3e-b725-dbb0a6fa92ae None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.803743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043bab1-48bf-4d3e-b725-dbb0a6fa92ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.814210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043bab1-48bf-4d3e-b725-dbb0a6fa92ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-2043bab1-48bf-4d3e-b725-dbb0a6fa92ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:35.819550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:35.820418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:35.821253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 251/479] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:35.829320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.924909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.947100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1fe73-7034-42eb-8d25-9dc9e092d75f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.990424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.991065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.991354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.991684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.992370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.992702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.994098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30d771-b583-4131-b1dc-01d7f6db000d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:36.003464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 229/480] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:37.130328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791d7d-bd4d-49bb-b354-9e9a997cd167 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.130871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791d7d-bd4d-49bb-b354-9e9a997cd167 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.130871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7791d7d-bd4d-49bb-b354-9e9a997cd167 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.132449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 252/481] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:37.138008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178759d-7690-4a56-adef-8a7969710f1b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.138440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178759d-7690-4a56-adef-8a7969710f1b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.138616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178759d-7690-4a56-adef-8a7969710f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.162071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f178759d-7690-4a56-adef-8a7969710f1b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:37.163272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f178759d-7690-4a56-adef-8a7969710f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:37.258005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 230/482] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:37.529727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70c66-284c-4ede-b571-f96601986d97 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.530083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70c66-284c-4ede-b571-f96601986d97 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.530269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70c66-284c-4ede-b571-f96601986d97 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.531984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 253/483] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:37.537472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.538010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.538496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.562092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:37.563779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:37.573912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac70c66-284c-4ede-b571-f96601986d97 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.666295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 231/484] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:37.722516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac70c66-284c-4ede-b571-f96601986d97 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.762794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d488217-3552-4776-8481-7041aa368297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.763473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d488217-3552-4776-8481-7041aa368297 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.763795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d488217-3552-4776-8481-7041aa368297 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.764066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d488217-3552-4776-8481-7041aa368297 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.778440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d488217-3552-4776-8481-7041aa368297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4d488217-3552-4776-8481-7041aa368297 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:37.783420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:37.784286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:37.785142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:37.786199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 254/485] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:37.791634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.794382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:37.841561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad40f83-3e25-44ba-ac7c-aedb09c72048 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.842124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad40f83-3e25-44ba-ac7c-aedb09c72048 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.842593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad40f83-3e25-44ba-ac7c-aedb09c72048 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.844168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 255/486] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:37.849500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.849782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.850049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.885617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:37.886814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:37.914191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375abad-7c79-4051-8402-1308e6b4310b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.955454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:37.968235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.968933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.969232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.974692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.975323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:37.975630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.977049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.993090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 232/487] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:38.005714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.027356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 256/488] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:38.036816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.126159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.180934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8d6fa-64d9-4888-8bcb-855b469d5af5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.188427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9832d29-0f01-437e-b75f-a4d9a6f29220 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.222056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffb153-6651-45ce-af48-96d88d48f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.223247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffb153-6651-45ce-af48-96d88d48f73c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.223525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffb153-6651-45ce-af48-96d88d48f73c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.223791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffb153-6651-45ce-af48-96d88d48f73c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.229755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.230330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.230592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.230853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.239545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffb153-6651-45ce-af48-96d88d48f73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3cffb153-6651-45ce-af48-96d88d48f73c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:38.244459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:38.246180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 257/489] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:38.247435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774f9a-8aa9-4942-b0ba-d72ffe57b185 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.247547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774f9a-8aa9-4942-b0ba-d72ffe57b185 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.247761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89774f9a-8aa9-4942-b0ba-d72ffe57b185 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.248664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.253353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 258/490] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:38.253353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774f9a-8aa9-4942-b0ba-d72ffe57b185 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.255198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c9ae2ab4-169f-4b0e-b832-c96870f4d47b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:38.275402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.276537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:38.277442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:38.277442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:38.277442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:38.283029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 233/491] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:38.283029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.283029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.283029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.287517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.306561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:38.308794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:38.366698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89774f9a-8aa9-4942-b0ba-d72ffe57b185 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.386803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 234/492] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:38.387663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.413429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.414705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.415246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.415922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.417514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:38.418015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.420489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.432341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 259/493] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:38.434486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.451716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.511520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa0f7e-1143-4841-811e-d75ae51c3678 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.548194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.551325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.552304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.552873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.553389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.554346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:38.554840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.557224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.564206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353088a-9444-4f8d-a042-6f0063546ebc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.579516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 235/494] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:38.580890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.607223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.608197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.608729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.609324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.624009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:38.630886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.631766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:38.632553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 260/495] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:38.633816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.697511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa20d75-67a1-43b9-8e81-8097c728fb14 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.705309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.734181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.734873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.735154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.735420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.742240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c6496-7fec-4541-850e-240272b402e7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.746515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.748008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:38.762934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.763932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:38.764813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:38.764813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:38.764813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:38.764813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 236/496] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:38.764813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.781926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.782607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.782886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.783158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.791263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.792746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:38.805181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.806086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 261/497] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:38.807561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.819600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.878007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd4ea-4751-448c-90cb-bb47e9f63222 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.912288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.912959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.913221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.913487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.914153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:38.914452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.915839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.918136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaed4e-9ab0-4b04-9564-4163e13f921f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.924099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 237/498] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:38.925591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.948977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.958027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.958659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.958936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.959207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.969276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:38.975004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.975953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 262/499] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:38.981464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.032426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d74a0e-9017-43df-99b8-8983b8ebd419 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.058777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.065482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.066089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.066362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.066631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.067289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.067571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.069001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.080290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 238/500] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.081079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.092337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e21a55-d569-44e8-bac1-9b1773bd2457 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.124974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.125646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.125896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.126169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.126896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.127199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.128651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a52a0e-e3e9-46c6-87e2-5ac7936c9f3e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.162295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.164886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 263/501] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.166360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d8aa-0e3f-4d64-b1d2-5c49838f7047 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.166642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d8aa-0e3f-4d64-b1d2-5c49838f7047 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.166919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d8aa-0e3f-4d64-b1d2-5c49838f7047 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.168251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 264/502] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:39.168821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d8aa-0e3f-4d64-b1d2-5c49838f7047 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.185807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb250a3-bf92-4527-bfb4-ef0058c51d14 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.219372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.220006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.220285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.220554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.230461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.231908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:39.246696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.247711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:39.248791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:39.248791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.248791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:39.252568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 239/503] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.253378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.268155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d8aa-0e3f-4d64-b1d2-5c49838f7047 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.294350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.305883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931786b-b694-478a-8929-792e6070baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.308909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931786b-b694-478a-8929-792e6070baac None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.308909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931786b-b694-478a-8929-792e6070baac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.308909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931786b-b694-478a-8929-792e6070baac None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.308909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931786b-b694-478a-8929-792e6070baac None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.308909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931786b-b694-478a-8929-792e6070baac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.309394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931786b-b694-478a-8929-792e6070baac None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.317634 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 265/504] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.318419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931786b-b694-478a-8929-792e6070baac None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.358581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e5049-04ab-4f4a-a695-e7d172258f2d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.387461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.393348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df58882-e758-4348-a457-6423def81734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.394015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df58882-e758-4348-a457-6423def81734 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.394289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df58882-e758-4348-a457-6423def81734 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.394540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df58882-e758-4348-a457-6423def81734 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.401927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df58882-e758-4348-a457-6423def81734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.403387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df58882-e758-4348-a457-6423def81734 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.412140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931786b-b694-478a-8929-792e6070baac None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0df58882-e758-4348-a457-6423def81734 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:39.415672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.416787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:39.417675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 240/505] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.418267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.418550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.418823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.437449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:39.438828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:39.447226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.447831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.448104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.448370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.503120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.507000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 241/506] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:39.507888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.515619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.517129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.607515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2b553-43b4-494a-bf79-fe2bba9469a2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.629933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 266/507] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:39.629933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.637245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.651244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.652153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.652431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.652967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.653606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.654053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.655972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.668993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 242/508] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.669795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.719074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.733082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62175bf8-7eb6-4bcb-9e67-21ab3f3f1130 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.769836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c462161-66f9-4066-8e53-b7060ba2a464 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.770290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.770913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.771192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.771455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.781511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.782953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:39.797014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.798032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:39.798865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:39.798865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.798865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:39.798865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 267/509] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.800298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.804450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.805472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.805912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.806319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.807415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.807965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.810312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.847474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 243/510] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.848289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.890213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.896528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a3814-5272-4e3b-a2fb-668ee72eae4f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.929278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.929915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.930190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.930463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.938866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.941259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.942951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.947288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa5fb8-5a21-446e-91a6-bea697f908e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:39.957178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.958082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:39.959186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:39.959186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.959186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:39.959186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 268/511] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.959186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.983235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.983868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.984146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.984458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.991844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.993348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:40.004742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.005612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:40.006478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 244/512] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.007021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.059997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65a80f-5b88-4cdb-b8f4-59b58f2d9cdb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.094190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.094804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.095084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.095356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.100792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.103813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f3c4-2a55-43ce-b636-2a95bbea09b2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.106248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.107830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:40.122192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.123131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:40.123974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:40.123974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:40.123974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:40.123974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 269/513] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.123974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.142800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.143349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.143625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.143891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.144526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.144876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.146258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.159311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 245/514] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.160104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.168474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.221836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6920a-6699-4764-9527-4ee1e089de7b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.254656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.255284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.255556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.255822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.257626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e366d7b-2d75-4cef-947c-248d08a4fa4a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.289740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.290628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.290906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.291176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.291809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.292104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.293509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.304201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 246/515] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.305067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.323774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.325269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.328250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.374609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.413269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3cf3e-22f8-4b11-923e-a3daf7267661 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.430184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 270/516] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:40.431475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.453221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.453853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.454124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.454396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.455106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.455405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.456864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.473926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 247/517] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.474743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.529266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad1b7c-ba27-4f1c-8b1c-340650dba0f8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.551469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.561669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.562279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.562619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.562890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.563531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.563835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.565231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.572880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194e87d-43ec-4635-bfbe-3ac7e9cb8e30 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.576675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 271/518] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.577461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.581056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.606972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.607604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.607879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.608147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.615556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.617048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:40.628592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.629695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:40.630858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:40.632819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 248/519] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.633841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.676461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e56a6-e91d-4881-8ddc-09fe9d401421 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.708543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.709194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.709466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.709733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.716144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.717618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:40.729372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.730215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:40.731056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 272/520] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.732086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443dde-a11e-41c0-8a59-bd39034579a3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.732204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.764227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.764890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.765171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.765441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.772337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.776478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.778142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:40.792491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.793447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:40.794397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:40.794397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:40.794397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:40.794397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 249/521] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.794397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.799331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.840193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14299f-7c34-4586-bb5c-797dd4f35c6e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.873634 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.874238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.874498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.874769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.896081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4889e0-eb28-466f-aaa8-8772d25e917d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.928975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.929498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.929769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.930026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.930675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.932144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.939926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.941414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.953973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 250/522] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:40 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:40.954659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.005814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.024497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.069140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0836de-c0c0-4773-982b-59822867d617 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.070502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 273/523] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:41.071555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.108796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.109652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.110248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.110248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.110944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.111602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.113092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.131522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 251/524] 10.222.0.65 () {56 vars in 1139 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.132360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.189080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037eebb-47b1-47d1-b822-e3e2c90d2f16 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.228386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.229482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.230056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.230330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.231021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.231316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.233449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.239092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7048bf4-f5a6-46b8-b73d-35bba7f4cdaa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.242260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.254650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 274/525] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.259938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.276320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.277730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.278213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.278616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.279496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.279943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.281661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.286884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.294959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 252/526] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.295968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.367266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d086b-a913-4a5a-bafc-fbc4f9aa9da3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.401879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.402513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.402791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.403053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398020b-af52-4af8-b0a4-c4b905829567 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.403154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.414237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.415697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:41.430589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.431762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:41.433154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:41.433154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:41.433154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:41.433154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 275/527] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.433154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.448922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.449681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.450230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.450230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.482088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.520603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.522276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.522419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.546970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843c55-fd11-4a88-8b7e-7e9a88e07668 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.582607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.583434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.583879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.584285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.585284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=3a919420853a4ac8b461e303fc993429) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.585839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.587273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.600936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 276/528] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/role_assignments?user.id=3a919420853a4ac8b461e303fc993429&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.602246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.642126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 253/529] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:41.643994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.716763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.735014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47d309-9d3a-4c55-b20a-40186283f056 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.761099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b79f5-f837-474a-a88f-32ef8457e7f3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.775188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.775837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.776115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.776450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.784519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.786041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.790153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:41.801376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.802280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:41.803093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:41.803492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.803492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.803492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.803492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.803741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 277/530] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.803806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.803877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.808407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.809988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.823540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 254/531] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.824396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.931178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e720e3-b997-4e68-b349-b728f82c96de None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.937039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61646-130e-49bf-be14-2d1c2494d480 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.964522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.972313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.973216 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.973561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.973928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.979991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.980689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.980966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.981231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.981920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.982223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.984124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.987282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.988808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.004890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 255/532] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.005789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:42.011612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:42.013630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:42.015635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:42.015635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:42.015635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:42.015635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 278/533] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:42.015635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.088099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.119954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0ad09-0c01-4195-8f57-001810f83576 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.133966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c5a2d-9eaf-4a8e-8bac-a08426ad07f6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.156300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.157118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.157497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.157868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.158905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=ebe21ca5e9924e458c2d37c28e7ee1b9) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.159318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.160890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.172607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 279/534] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/role_assignments?user.id=ebe21ca5e9924e458c2d37c28e7ee1b9&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.173684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.173886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.174319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.174687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.174957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.182800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.185305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:42.199556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:42.201073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:42.202533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:42.206186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 256/535] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:42.207770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.261582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.330732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac6e45-61b6-4463-b715-4412cdc1e277 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.376345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.377022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.377301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.377572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.378279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.378580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.380269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.402512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 257/536] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:42.408641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.465972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961fdf4-35b6-4f92-8ae6-756eb5ff61ac None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.489030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.507838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.508684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.509029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.509362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.510071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.510432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.511920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.525151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 280/537] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.530587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.555082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb692d1-d12f-4911-82d2-59b6bdf2cc51 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.559236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.621506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.622247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.622527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.622800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.623531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=d81e355fe7294414a24428411ade0019) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.623838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.625365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.640713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 258/538] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/role_assignments?user.id=d81e355fe7294414a24428411ade0019&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:42.709844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67bf12-0718-4e13-9bb3-dd5011b159d3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.761726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.762499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.762712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.762982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.772982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.774531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:42.793790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:42.794699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:42.796217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 281/539] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:42.801422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.938948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535207-ae9f-4097-8921-cfd5ef27f999 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.974072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.975121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.975597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.976069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.977003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.977540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.979171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b347b4-2866-4198-adce-3227a98ee1b8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.992506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 259/540] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.998114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.064631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:43.147539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0775-fa64-4c4d-a3a0-887d010fc82e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.198658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.199266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.199539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.199805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.200535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=5dbd68ef35a54c45baada1c45509985c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:43.200855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.202284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db005f3-c6c2-4828-9a10-e3687510ddf2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.212905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 282/541] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/role_assignments?user.id=5dbd68ef35a54c45baada1c45509985c&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:43.413470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204d60-31aa-4e10-8834-bb740543767e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.414495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204d60-31aa-4e10-8834-bb740543767e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.415029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10204d60-31aa-4e10-8834-bb740543767e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.417019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 260/542] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:43.423317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce186e-2cd2-4ae4-9c0a-7a574ac84f6f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.423317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce186e-2cd2-4ae4-9c0a-7a574ac84f6f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.423543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce186e-2cd2-4ae4-9c0a-7a574ac84f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.450355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a0ce186e-2cd2-4ae4-9c0a-7a574ac84f6f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:43.451561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a0ce186e-2cd2-4ae4-9c0a-7a574ac84f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:43.554864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 283/543] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:43.956359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204d60-31aa-4e10-8834-bb740543767e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.998985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.075918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2333b1-9ac7-4aa6-b99e-9ca4fd11a681 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.076240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2333b1-9ac7-4aa6-b99e-9ca4fd11a681 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.076501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2333b1-9ac7-4aa6-b99e-9ca4fd11a681 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.078177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 284/544] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:44.090149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.090480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.090825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.112027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10204d60-31aa-4e10-8834-bb740543767e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.127063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:44.128552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:44.175997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.176961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.177090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.177285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.177551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.195493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:44.210240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:44.211333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:44.212311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:44.213033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 261/545] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:44.218363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.262435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 285/546] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:44.337001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.342741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648f64-d65d-4f41-9fb1-9e6385b96e18 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.384109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.384753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.385029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.385299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.385966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:44.386265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.387685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.396456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 262/547] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:44.401812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.557366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013662ad-8cd1-40d0-a04c-1c1ba91d655b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.595550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.596185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.596470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.596771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.607000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.608463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.619219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:44.625486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:44.626635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:44.627497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:44.627497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:44.627497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:44.627497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 286/548] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:44.633660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.653753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.776240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d4e2f-ced3-4ad4-a44b-103b78b4b28f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.791157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab434d-5f1a-41da-abe3-d5d18f74a3e7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.812599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.813290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.813569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.813838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.814478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:44.814782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.816282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375460e-f2d6-494c-9abe-5e1f42d60423 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.828773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 287/549] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:44.829997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c18e9d-d97f-48df-a7f5-58f09dd12752 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.830278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c18e9d-d97f-48df-a7f5-58f09dd12752 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.830548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c18e9d-d97f-48df-a7f5-58f09dd12752 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.831954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def6500-d7b9-49bc-94ce-6348a6f48dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.832094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 288/550] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:44.832628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def6500-d7b9-49bc-94ce-6348a6f48dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.832996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def6500-d7b9-49bc-94ce-6348a6f48dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.833268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def6500-d7b9-49bc-94ce-6348a6f48dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.835188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c18e9d-d97f-48df-a7f5-58f09dd12752 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.848357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def6500-d7b9-49bc-94ce-6348a6f48dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6def6500-d7b9-49bc-94ce-6348a6f48dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:44.854503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:44.855559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:44.856362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:44.859097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 263/551] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:44.860558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.861080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.861898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.881418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:44.883058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:44.886430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.913174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.950805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c18e9d-d97f-48df-a7f5-58f09dd12752 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.957209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 264/552] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:44.958087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.023001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.023650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.023928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.024197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.036840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.038288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:45.066605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.067744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:45.068702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:45.073402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 289/553] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:45.078824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.138485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129a6f-6e0a-4862-84d4-8148c367aeac None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.201358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.201989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.202269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.202537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.203240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.203540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.205998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.222989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 265/554] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:45.227214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.232996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.272049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d73f-9968-4e71-993f-c0acd8c604e0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.317303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.324289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.325244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.325718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.326196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.327136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.327680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.330042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.350673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 290/555] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:45.351858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.378468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a85d-0ca6-4ad0-8e04-e5dae4a71994 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.412448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.413371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.413652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.413921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.424318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.425821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-750d595b-84b8-440b-b8ff-080886e55e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:45.440198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.441219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:45.442074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:45.442074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:45.442074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:45.445798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 266/556] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:45.447053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf809-7469-414d-bf96-00615f7b5c99 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.447331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf809-7469-414d-bf96-00615f7b5c99 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.447597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cf809-7469-414d-bf96-00615f7b5c99 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.452925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 267/557] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:45.453768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf809-7469-414d-bf96-00615f7b5c99 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.475940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffb5b2-3b57-41bb-87a7-328854c4ccdd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.513253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.514539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.515331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.515540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.515865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.526452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:45.531675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.533289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 291/558] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:45.534133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.569146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cf809-7469-414d-bf96-00615f7b5c99 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.587956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.605755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.606381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.606656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.606924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.641698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4eff8-bf7d-448c-93d2-9269c70cc436 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.676365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.677885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.678933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.679538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.679982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.680280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.681752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.682058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.683411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639b821-743e-473e-af4a-50fe37fbcf6c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.696827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 292/559] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:45.702184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.702475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.703176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.721249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:45.722427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:45.734460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.786629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 268/560] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:45.787615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.803738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 293/561] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:45.805247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.855593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.908750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c796f8-3594-48da-a59d-9b5ae3e7e6d6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.920906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf631fb-535e-4fa4-aa92-31c629256f4f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.943912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.944509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.944806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.945079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.945738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.946032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.947397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.955400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 269/562] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:45.956173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.964652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.965477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.965914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.966322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.973841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.976087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.977567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-66146ad0-a632-4ac2-a7db-b6ce53d800c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:45.989668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.990623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:45.991657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 294/563] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:45.992256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702a84d-fdd8-4fad-a8ad-351ef0daf158 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.992256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702a84d-fdd8-4fad-a8ad-351ef0daf158 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.992376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702a84d-fdd8-4fad-a8ad-351ef0daf158 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.993751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 295/564] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:45.994285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702a84d-fdd8-4fad-a8ad-351ef0daf158 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.068569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddd75c-ae76-4779-bfeb-ddf9b3a8ac29 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.095225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.099595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702a84d-fdd8-4fad-a8ad-351ef0daf158 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.102907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.103556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.103831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.104095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.116584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.118504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.133049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:46.133331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.134311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:46.135203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:46.135203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.135203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:46.135371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.135371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.135371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.135558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 270/565] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.135558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.148573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.150061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-78aaed99-9e48-4878-880f-69463ef605b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:46.164737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.165852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:46.167070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:46.167070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.167070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:46.167070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 296/566] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.167354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.167572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.167839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.185457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:46.186629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:46.206182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.241300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5cfe-1591-4703-9282-184ed62f9962 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.253379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 297/567] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:46.254193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.275426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.276034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.276312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.276582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.277330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:46.277635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.279072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.296769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 271/568] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:46.297719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.347915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.371167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9401d3-6ef2-431d-abcb-e825eed52083 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.400195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d35cc-7247-45c0-a3b4-cd7196d2f1ec None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.405993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.406655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.406933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.407203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.417250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:46.422098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.423010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:46.423857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 298/569] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.424556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.433950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.444030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.444235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.444524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.444745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.445413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:46.445687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.447305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.460554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 272/570] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:46.461480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.538680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9766c-5d67-458a-a8cd-4d0e8e579405 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.565001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12f131-d331-42be-84c6-dece517cc902 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.570918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.571563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.571820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.572088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.572757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:46.573054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.574659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.585954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 299/571] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:46.586733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.589404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.602566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.603216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.603493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.603762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.614870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.616329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:46.630620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.631680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:46.632799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:46.632799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.632799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:46.636268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 273/572] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.636994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.676140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.685362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f49f4-ddcc-4c6f-8d30-cb54b31dc36c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.718411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.719095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.719389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.719651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.720316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:46.720637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.722033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.735650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b500a8-7b4a-4055-93b4-181a9423ca41 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.737648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 300/573] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:46.738359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.770904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.771543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.771821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.772092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.779021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.780485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:46.791788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.792866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:46.793964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:46.796763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 274/574] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.798072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.800183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.838736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba20b-a7f4-49bc-ba43-660e6b123bca None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.871062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.871683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.871960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.872228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.881990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:46.887101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.888165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 301/575] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.889124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.897432 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.901869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd4bbf-a4f6-4644-9d4c-b34d333f03ba None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.934869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.935485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.935765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.936026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.943374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.944864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:46.955906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.957022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:46.958211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 275/576] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.958930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.992604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45827115-147f-47e5-a7d0-8afb3dd1c106 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.014997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.026362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.026987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.027261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.027509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.028224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.028525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.029927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.041804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 302/577] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.042560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.057682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cd82b-aa8d-4474-aa4c-6428df722650 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.091583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.092205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.092466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.092761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.103322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.104853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:47.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.123111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:47.128823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:47.128823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:47.128823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:47.128823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 276/578] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.128823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.141606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.144814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec934c-0bf3-40a1-8730-afc5d5dc9435 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.178960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.179576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.179858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.180131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.180853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.181161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.182607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.193743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 303/579] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.194661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.231677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488debdd-45ea-453e-9034-0f2b6dc0fba5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.240565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.264715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.265331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.265652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.265917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.266578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.266873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.268256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.275931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 277/580] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.276748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.295270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b828ab-39fc-42de-b2c5-5cdfdb65c23e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.328148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.328779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.329065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.329323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.330057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.330375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.331788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.344710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.348949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 304/581] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.349783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.377064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469609bf-0340-458b-acea-f47e9059c7d6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.411605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.412166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.412438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.412739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.420541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.422012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:47.433620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.434720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:47.435613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 278/582] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.436092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.453196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734d05-47de-42ec-9885-ece07ad3f279 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.454739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.488592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.489231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.489509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.489788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.490427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.490730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.492089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.503425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 305/583] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.504095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.532924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713a36-e9e2-4b1b-a90d-df6ae5f72acb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.562555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.568629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.569251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.569527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.569792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.570510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=060c831449d541a28a826628ac472ebd) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.570815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.572280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.577650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 279/584] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/role_assignments?user.id=060c831449d541a28a826628ac472ebd&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.578413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.619069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9830844-dd13-4939-b91f-b76e3398b426 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.654968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.655777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.656154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.656526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.668494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.669949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:47.687379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.688724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:47.689820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:47.689820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:47.689820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:47.695726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 306/585] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.695726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.695991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5775b-77eb-4c62-bf51-54de6228d539 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.711156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.733099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.733749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.734031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.734291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.748358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.749869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:47.765536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.766600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:47.767491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:47.767491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:47.767491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:47.771499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 280/586] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.772357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.807623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659a62e-17aa-4b78-8e23-9c524bf255a2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.822781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.842188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.842808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.843087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.843357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.844128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.844434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.845905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.862915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 307/587] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.862915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.879341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f40551-8cb3-4a06-809b-0ba6beb75c13 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.915674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.916410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.916801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.917128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.925460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.926911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.937670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:47.941871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.942810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 281/588] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.943736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.974081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab54074-f116-42a5-9b4d-c5c796db704d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.009083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.009694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.009977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.010247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.010891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:48.011201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.012560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.024545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 308/589] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:48.025359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.057871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7e29c-c287-4a42-b5da-6e2104f07b42 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.067228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.095132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.096070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.096348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.096651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.097566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:48.098658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.100083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.113979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 282/590] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:48.114801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.132690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10523b4-2606-46e8-b7ed-c28a722b2af3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.166485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.167287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.167664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.168044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/3a919420853a4ac8b461e303fc993429/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.170887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.184344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=3a919420853a4ac8b461e303fc993429, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.185748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.204654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 309/591] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:48 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/3a919420853a4ac8b461e303fc993429/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:48.204654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.228201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33030add-056b-4ac0-8544-0712f8635dac None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.277825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.278569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.279048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.279422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.280284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:48.280749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.282601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.304711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 283/592] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:48.305851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.331013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18107ba-8e93-4a41-8b2c-5092501969b9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.337395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.369052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.369708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.369989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.370259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.378520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.379981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:48.393149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:48.394363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 310/593] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:48.395521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.427337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b0c12-d093-4f77-9773-76ee8fc35291 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.448844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.466765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.467572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.467967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.468323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.476186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.477787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:48.492670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:48.493742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:48.494808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:48.500895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 284/594] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:48.501925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.537234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870cb51-1020-47ae-b74d-b7d1fc457b10 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.583152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.584046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.584470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.585420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.594420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.600797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.603678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.613093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe514-bbbd-4f2c-9d93-f216788fb807 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:48.623166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:48.624685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:48.625860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:48.625860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:48.625860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:48.632885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 311/595] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:48.634439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.655740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.656517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.656941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.657303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.658122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:48.658641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.660314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.684044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 285/596] 10.222.0.65 () {56 vars in 1139 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:48.685233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.757334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.766466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac93ae-24dc-4d47-bea3-e83525492d51 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.795033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b461c-b4d9-4ef2-9091-04cb7a300ed6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.813345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.814600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.815026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.815435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.816300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:48.816791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.819194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.831517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.832251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.832639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.833000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.833744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:48.834133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.834883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 312/597] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:48.835748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.836098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.852699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 286/598] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:48.852699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.853232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:48.961352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48456403-c824-4217-bba3-5f96c13b2fd7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.987428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40b5d4-b3d9-40d9-810e-1a7f6ee4b473 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.034638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.035372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.036159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.036729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/ebe21ca5e9924e458c2d37c28e7ee1b9/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.053458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.054353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.054780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.055196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.056222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=ebe21ca5e9924e458c2d37c28e7ee1b9, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.057816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.077032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 287/599] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:48 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/ebe21ca5e9924e458c2d37c28e7ee1b9/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:49.078268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.083899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.085800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:49.122747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:49.124010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:49.125202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:49.125202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:49.125202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:49.134180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 313/600] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:49.142174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.155887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.166296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.229705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6618af7-447e-4d59-bed1-9a2b2eb4fe21 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.301451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.302488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.302971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.303425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.311489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.313318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:49.326714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:49.327657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:49.328632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:49.330728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 288/601] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:49.345054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.474563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ce1f0-e1a2-4e14-9067-9cd303d32867 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.492271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.494055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c33d-58ea-4c74-b3bf-653ace86cfd1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.518241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.520121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.520602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.521088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.521979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:49.522494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.524763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.539610 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 289/602] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:49.545709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.562380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.562972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.563251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.563521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.565438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:49.565740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.567137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.588864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 314/603] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:49.594812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.678958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.711260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b506ab1-ad90-42f3-9ba6-5b8910fca05b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.731031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c11f3-5d55-4aab-b257-f5c9df65fc1c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.768813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.769471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.769749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.770021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.777703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.779197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:49.791818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:49.792854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:49.793743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 315/604] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:49.798688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.818559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df871a2e-59d2-429a-b68a-a262e277aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.819196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df871a2e-59d2-429a-b68a-a262e277aafa None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.819413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df871a2e-59d2-429a-b68a-a262e277aafa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.819680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df871a2e-59d2-429a-b68a-a262e277aafa None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/d81e355fe7294414a24428411ade0019/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.848630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df871a2e-59d2-429a-b68a-a262e277aafa None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=d81e355fe7294414a24428411ade0019, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.850097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df871a2e-59d2-429a-b68a-a262e277aafa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.886780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 290/605] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:49 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/d81e355fe7294414a24428411ade0019/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:49.894882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ba81-1ccd-4f62-a4b6-794721eaf019 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.895577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ba81-1ccd-4f62-a4b6-794721eaf019 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.896047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096ba81-1ccd-4f62-a4b6-794721eaf019 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.897915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 291/606] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:49.904073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.905773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.906296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.930344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:49.931570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:49.954397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.956696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c864a9-3af1-4d89-98f3-3ab5958ce92e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.016402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.031478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 292/607] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:50.039121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.040042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.040523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.040980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.041842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:50.042297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.043941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.066844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 316/608] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:50.073235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.196863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e6d1-4a7f-4715-b205-986bd16a295a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.233686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.234399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.234677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.234944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/5dbd68ef35a54c45baada1c45509985c/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.250831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=5dbd68ef35a54c45baada1c45509985c, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.252307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.278037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 293/609] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:50 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/5dbd68ef35a54c45baada1c45509985c/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:50.375325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.506206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f857dd6-12d6-4c9a-8966-92463ecced94 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.548194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce8df-11cd-4396-b61b-10fe11acd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.549135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce8df-11cd-4396-b61b-10fe11acd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.549585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce8df-11cd-4396-b61b-10fe11acd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.550002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce8df-11cd-4396-b61b-10fe11acd0b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.562765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ce8df-11cd-4396-b61b-10fe11acd0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8a6ce8df-11cd-4396-b61b-10fe11acd0b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:50.567979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:50.569262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:50.570277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:50.572697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 317/610] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:50.580673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.583222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.693947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b941ba-8718-414c-944e-ffb6a6799f29 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.694455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b941ba-8718-414c-944e-ffb6a6799f29 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.694455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b941ba-8718-414c-944e-ffb6a6799f29 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.696178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 318/611] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:50.701931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.702212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.702479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.721441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:50.722639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:50.728602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72370346-93eb-414d-97dc-78130ee5c033 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.794111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.801660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.802134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.802571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.803399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:50.803838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.805395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.814903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.823089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 294/612] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:50.831107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.871654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 319/613] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:50.916550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.969437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f9ced-9fa7-4852-aba5-c73d9f39c37b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.021333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.021989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.022270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.022544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.033900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.035361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:51.056029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.057255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:51.058184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:51.058184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:51.058184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:51.058184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 295/614] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:51.062776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.199785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19083ed-0967-4cf4-bbab-4db371bd7ab6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.247995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.248942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.249404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.249861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.250768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.251248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.252835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.265171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 320/615] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:51.273941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.311518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.354188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.425791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78131522-f114-4b00-9428-71e39bcb3561 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.471412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.472599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.473120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.473597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.484838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:51.490280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.491225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:51.492068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:51.492761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1e97-5446-4260-aa77-6a21edd5e0e3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.496867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 321/616] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:51.508578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.520987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.550147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.552446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.552741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.553010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.562922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.564383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:51.576123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.577102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:51.578052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 296/617] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:51.583143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.685437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887b31c-0f30-4297-a2e0-888190f4a332 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.721622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.722232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.722562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.722828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.723603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.723960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.726005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.746047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 297/618] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:51.751845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.790394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.791572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.799831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c14189-c903-4ed2-8c76-dab9212616a8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.864917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9026d01-f7dd-4fee-b17b-5c3c021eb533 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.887061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.887708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.887977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.888247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.888971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.889268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.890736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.903588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 322/619] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:51.910958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.936413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.937085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.937368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.937769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.954271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.955723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:51.982204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.984540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:51.987154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:51.987154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:51.987154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:51.987154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 298/620] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:51.990769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.072940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a91ec9-bbf6-41e8-a15d-c98d1579bd81 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.109240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.110355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.110876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.111350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.112236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.124527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.126450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.127588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e5d64-1b98-49a3-b8cc-d40811ea244d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-9b6d0a27-9ea3-492b-952b-250414f9713d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:52.142370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:52.143344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:52.144227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:52.144227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:52.144227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:52.147433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 323/621] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:52.148993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08565921-183f-408f-ac3c-a5d278ecd17f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.149479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08565921-183f-408f-ac3c-a5d278ecd17f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.150054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08565921-183f-408f-ac3c-a5d278ecd17f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.151797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 324/622] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:52.153008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08565921-183f-408f-ac3c-a5d278ecd17f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.166663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.167681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.167963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.168235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.169233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.169541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.171342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.171455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c63e9b-8bfe-4637-bcaa-60d6243bc23b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.189678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 299/623] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:52.191654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.191941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.192235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.216163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:52.217506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:52.279910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08565921-183f-408f-ac3c-a5d278ecd17f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.293213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 300/624] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:52.294480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.324671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.329265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.329757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.330269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.331183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.332250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.334044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.357969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 325/625] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:52.364475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.417366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.475596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f664907-0746-4996-8525-5addc4ff87ae None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.509275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.542028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.543047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.543551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.544028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.555298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.557577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.560687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a8fe-d0be-4dca-ad8a-e499c7308b43 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f2c17b9f-65be-4756-8d7d-9e9c3b4f3e73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:52.573165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:52.574084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:52.575066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:52.577334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 301/626] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:52.578769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832554-e6b2-47f6-92f3-cf123664f216 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.579252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832554-e6b2-47f6-92f3-cf123664f216 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.579730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93832554-e6b2-47f6-92f3-cf123664f216 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.581413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 302/627] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:52.585743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832554-e6b2-47f6-92f3-cf123664f216 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.608820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.610101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.610725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.611197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.620575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.622447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-76128122-736f-44a5-85ba-71919d15fadc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:52.638060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:52.639057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:52.640000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 326/628] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:52.640767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750132-411c-4b00-ae30-f618150f78da None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.640959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750132-411c-4b00-ae30-f618150f78da None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.641211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750132-411c-4b00-ae30-f618150f78da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.660882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-28750132-411c-4b00-ae30-f618150f78da None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:52.662236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-28750132-411c-4b00-ae30-f618150f78da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:52.708915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93832554-e6b2-47f6-92f3-cf123664f216 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.748636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 327/629] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:52.748636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750132-411c-4b00-ae30-f618150f78da None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.754482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.755184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.755462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.756137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.756584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.756914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.758456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.766712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.774312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 303/630] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:52.775162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.811721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.853101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750132-411c-4b00-ae30-f618150f78da None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.874380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc61a75-f753-427d-9326-56172fe131f9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.892097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f78a-8824-489c-881d-7c57c50c79d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.892774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f78a-8824-489c-881d-7c57c50c79d8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.893170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f78a-8824-489c-881d-7c57c50c79d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.893322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f78a-8824-489c-881d-7c57c50c79d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.904650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6f78a-8824-489c-881d-7c57c50c79d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4de6f78a-8824-489c-881d-7c57c50c79d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:52.909447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:52.910700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 328/631] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:52.912417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4099-0825-4d8e-9860-54eb5de41207 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.913364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4099-0825-4d8e-9860-54eb5de41207 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.913364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4099-0825-4d8e-9860-54eb5de41207 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.914114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 329/632] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:52.914318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4099-0825-4d8e-9860-54eb5de41207 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.919186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.919815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.920091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.920355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.921123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.921427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.922935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.940783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 304/633] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:52.941760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.998613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.025658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4099-0825-4d8e-9860-54eb5de41207 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.043840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be193f8f-c0b2-4353-91e7-77a539d4fafc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.047556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.058844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.059491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.059763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.060029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/060c831449d541a28a826628ac472ebd/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.074512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=060c831449d541a28a826628ac472ebd, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.075957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.077252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.077853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.078217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.078487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.079136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:53.079426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.080947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0121a5-1ddb-426f-9e74-b1ae3a3d8ec5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.089529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 305/634] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:53.090687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.090922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 330/635] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:52 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/060c831449d541a28a826628ac472ebd/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:53.091027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.091223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.092041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.112967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:53.114156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:53.189510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 306/636] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:53.198928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.210813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8623cb-fb8f-44d5-b765-4a6c209ecacb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.248781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.249411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.249741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.250087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.262339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.296260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.320378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608a88-046b-4634-bda8-565ef2bfd5ae None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.330575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.330831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.367520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.368957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.369233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.369500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.383429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:53.390177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.391155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:53.391975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 307/637] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:53.396910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.451396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 331/638] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:53.456712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.510406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9ec5-1ada-49e1-916e-99014c24f5ab None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.519855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.529696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.549711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.550431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.550718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.550983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.561563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1ea3d-7c8f-428c-8409-fe7cf6f15321 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.561701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.563076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:53.577510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.578701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:53.579823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:53.579823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:53.579823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:53.583461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 308/639] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:53.584299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.599808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.600758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.601169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.601573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.602398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:53.602963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.604572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.613924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 332/640] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:53.615131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.687001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eddf4-e451-44b2-8554-2f07e4410414 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.719883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef853a45-a094-4306-95e2-53063e26b2d3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.721651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.722302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.722575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.722853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.733521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.735060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:53.749552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.750680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:53.751580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:53.751580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:53.751580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:53.751580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 309/641] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:53.752217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.759730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.760370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.760682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.760957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.762990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.766882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.775071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:53.780411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.781619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:53.782478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 333/642] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:53.783174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.856909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5acab5-4c6e-4117-87f4-246ffa698f36 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.889244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380699-4b33-41d0-8fab-169713136445 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.891873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.892487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.892807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.893066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.893702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:53.893998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.895372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.908530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 310/643] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:53.909398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.930221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.930863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.931140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.931410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.944025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.945442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:53.959409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.960386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:53.961485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:53.961485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:53.961485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:53.961485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 334/644] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:53.961485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.987725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.012646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.027700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2de1ac-32fa-4815-b047-3e95513febb5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.063037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.063756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.064094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.064436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.065108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.065396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.066774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.070458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869c21-f046-44ac-a06e-3943c1ee672e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.078298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 311/645] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.079095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.112508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.113246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.113521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.113787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.114505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.114805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.116330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.129739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 335/646] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.129739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.185336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d4ca-096c-4a0e-aff7-651be6c5bdd0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.217700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.223925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.224788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.225067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.225339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.233118 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.234586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.236295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb0d91-31ee-40db-ab84-dc05a7195eb5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.245986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:54.246116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:54.246987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:54.247901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 312/647] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:54.248508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.277097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.277821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.278101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.278374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.279128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.279437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.280937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.296986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 336/648] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.298087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.353322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f8bdf-16ba-49c3-96de-82fc7bc776c8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.387698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.388481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.388891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.389258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.396075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.397562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.401234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d8396-cd58-4d6b-b497-5719b9f9b732 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:54.409011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:54.410072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:54.411262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:54.415125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 313/649] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:54.415785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.442660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.442890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.443157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.443437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.456049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.457622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:54.474197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:54.475298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:54.476217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:54.476217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:54.476217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:54.476531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.476626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 337/650] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:54.476626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.502405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.526495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e5114-21cf-497e-81b6-b13949c17e4a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.561889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.562624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.562970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.563309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.564050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.564351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.565822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.583023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 314/651] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.583921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.592562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4f33-fa79-4b51-82ba-df20ae527e1c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.635002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.635857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.636245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.636662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.645544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.646978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:54.658748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:54.659680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 338/652] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:54.661229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.687654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4b1a-be23-4e6a-9599-83db022cdf28 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.700520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.725356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.726199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.726483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.727025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.727719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.728023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.729645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.744768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 315/653] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.745692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.751035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.772957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5fb44-121e-4f85-9783-2de5c2a387c5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.806418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.807027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.807306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.807581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.808226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.808520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.809917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.827452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 339/654] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.828054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.855450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b030a9-319a-4cb5-ab76-b54298361c3a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.892088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.892889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.893271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.893626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.934145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b7eee-cd78-4df1-93b8-49ac1c73d4ab None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.937459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.971511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.971732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.972126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.972521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.972811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.973353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.973539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.973839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.975261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.984539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.996663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 340/655] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.996663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.090350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 316/656] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:55.090350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.102270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b8680-cc3e-414d-9b36-10cd3481a797 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.141477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.142084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.142361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.142626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.143437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=3a919420853a4ac8b461e303fc993429) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:55.143652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.145100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.150953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 341/657] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/role_assignments?user.id=3a919420853a4ac8b461e303fc993429&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:55.151668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.184484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.225636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.243627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd840-bd73-4b6a-91d1-0b4ff6c98d1d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.275563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409f10a-1a1b-46c9-b589-164e72e248bf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.283841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.284589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.284968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.285303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.293974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.295766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:55.309125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:55.310178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:55.311108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 317/658] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:55.311703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.319861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.320503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.320838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.321081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.405186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.406727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.427499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f4ad-6f82-406c-8658-67f294e898c3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.461685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.467855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.468507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.469184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.469451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.475485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.480361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.481877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9726678a-791d-43ad-bd2f-66321d7f2062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:55.496647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:55.497711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:55.498744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:55.498744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:55.498744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:55.500888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 318/659] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:55.502439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40fdf-1cc0-49ca-a32c-a59442ff6add None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.502826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40fdf-1cc0-49ca-a32c-a59442ff6add None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.503359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40fdf-1cc0-49ca-a32c-a59442ff6add None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.505036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 319/660] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:55.505804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40fdf-1cc0-49ca-a32c-a59442ff6add None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.519977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 342/661] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:55.521038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.625746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40fdf-1cc0-49ca-a32c-a59442ff6add None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.627208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88722d7-94a7-4bfd-8efc-1e4d97c6f09a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.661362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.661987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.662256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.662529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.663171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:55.663469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.664716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.664842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ec466-99f9-4880-8934-cd4b8db721bb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.665583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.666004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.666535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.667844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:55.668286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.669860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.676204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 343/662] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:55.677448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.677732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.678005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.695871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 320/663] 10.222.0.65 () {56 vars in 1139 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:55.696073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:55.697072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.697283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:55.716341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.743051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.771313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 344/664] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:55.772305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.812084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705185-dd8a-4968-af14-ca37bbec2805 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.847413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.848052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.848329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.848606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.859701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.861395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.873101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00913-e3cb-4cf1-8b6e-43ab6c4104c3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:55.877766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:55.878691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:55.879564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:55.879564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:55.879564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:55.883698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 321/665] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:55.884605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.912771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.913877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.914211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.914597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.922036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.923567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:55.935308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:55.936720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 345/666] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:55.937667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.955183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.016361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.028957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7f044-7ec4-4e7b-ad83-6cd64fd3a3cf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.049177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fa02-0cf4-457b-bf69-eaede01adb39 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.073311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.073931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.074208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.074476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.083159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.083787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.084058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.084321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.085079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.085379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.086858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.104446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 346/667] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.104446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.154922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.156831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.174104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.206663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996e28-646a-4985-b4d5-4d096467e5dd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.252035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.252717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.253007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.253283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.254128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.254257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.255662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.261155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.274039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 347/668] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.274039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.274324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 322/669] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:56.274324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.376257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd2f36-389d-4a6c-9149-535d0d73ad2a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.378590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8a4a0-8405-4f41-9b9a-015d0a662234 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.408165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.414243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.415046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.415474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.415834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.419676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.420408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.423562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.423562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.427810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.429399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.430095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:56.435234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:56.436363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:56.437407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 348/670] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:56.442160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:56.444661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:56.445701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:56.446813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:56.450842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 323/671] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:56.451633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.504529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.550646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880477-f89f-41d2-b13c-d499e44edef8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.554532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8f4a8-725e-46d9-b60c-9acd2bffb824 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.587576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.588189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.588467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.588820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.589492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=ebe21ca5e9924e458c2d37c28e7ee1b9) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.589799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.590938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.591220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.591764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.592130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.592489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.604968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 349/672] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/role_assignments?user.id=ebe21ca5e9924e458c2d37c28e7ee1b9&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.604968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.609982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.611608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:56.629125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:56.630319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:56.631419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:56.631419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:56.631419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:56.637318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 324/673] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:56.638562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.674940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.734964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c759cfa-89a6-4f2e-bc2d-6ad0a6c5419d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.767150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d6ed-ce5b-44d5-b03e-5a5ae6f872ea None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.770840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.774358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.775287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.775782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.776262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.777207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.777728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.780255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.795622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 350/674] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.797123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.807781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.808891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.809165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.809434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.810131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.810433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.812219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.826978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 325/675] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.827837 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.921100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825d4e0-ecdf-4010-8f5d-85a3bdb30edf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.941297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.947596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3715c-2212-4e7e-a36e-012593a032fa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.959520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.960606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.961018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.961388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.962543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.963196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.968664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.982567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 351/676] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.983435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.994267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.995083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.995458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.995826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.007797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.009552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:57.025928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:57.027519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:57.028647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:57.028647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:57.028647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:57.032643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 326/677] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:57.032643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.053845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.115126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70868614-fb48-4f27-9802-925c55fd0e9c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.151191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.151956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.152332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.152723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.153605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=d81e355fe7294414a24428411ade0019) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.154009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.155471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3ba8f-55a2-4e3c-ab1b-78c8cdae4701 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.155644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.169060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 352/678] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/role_assignments?user.id=d81e355fe7294414a24428411ade0019&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.170181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.196237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.200673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.200673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.200673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.217430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.219282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:57.245091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:57.247190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:57.249338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 327/679] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:57.259781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.266665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.366393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3285fbf-6922-4155-a686-5316101759e2 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.409834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.410451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.410730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.410998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.411185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.411642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.412103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.413433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea668f-d8d2-454f-9be3-3d4de4901f29 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.428062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 353/680] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.428249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9802b2-b90d-449f-ba61-a5bd166d4a82 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.428495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9802b2-b90d-449f-ba61-a5bd166d4a82 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.428717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9802b2-b90d-449f-ba61-a5bd166d4a82 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.430138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 354/681] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:57.437663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1088aa-d5b3-4066-a6e9-1c86a708755a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.439421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.439743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.440783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.461991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:57.463106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:57.481794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.482422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.482699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.482968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.483658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.483956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.485545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.503397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 328/682] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:57.503397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.546727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 355/683] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:57.548727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.588396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.658285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08271fe-0110-4050-92fc-288d83e5fc03 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.674977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38a0d4-0706-417d-9256-ad2914487950 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.709297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.709940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.710193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.710465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.711197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=5dbd68ef35a54c45baada1c45509985c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.711503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.713020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.715515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.716177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.716455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.716747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.719239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 356/684] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/role_assignments?user.id=5dbd68ef35a54c45baada1c45509985c&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.722938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.730737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.732216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:57.754768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:57.755813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:57.756806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 329/685] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:57.762277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.892630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.898979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.899812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e35d92-f8c5-438a-be0e-d31c4290a006 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.942998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.944505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.945020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.945704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.948497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.949975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.952390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.988689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 357/686] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.993689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.076574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a40ca-868a-4b45-b197-1adcf5997566 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.121199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46630-7923-43c5-a004-287560626d2d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.126435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.127131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.127416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.127685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.142230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:58.148339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:58.149296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:58.150142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 330/687] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:58.161875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.169995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.170654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.170931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.171195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.207592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.238124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.287553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f0c1e-f86a-406d-8e1d-6324a8abf751 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.326816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.327487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.327763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.328037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.329035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:58.329335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.330717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.343381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.344903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.350437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 331/688] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:58.366035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.540822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 358/689] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:58.546294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.561122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42bd25-6e64-4039-9fca-c32dbe464b54 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.593475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.625742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.626440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.626720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.626987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.643323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.644803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.660379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:58.667748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:58.668742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:58.669639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:58.669639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:58.669639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:58.675578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 332/690] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:58.682372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.781171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38150593-7c27-49b4-a161-5f0f7201fd0c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.805505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ab71-5c8f-47b1-82e0-c3ab319c0916 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.853360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.853999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.854272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.854540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.865343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.865707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.865973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.866253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.866522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.867156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.867261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:58.867446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.868838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:58.887102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:58.888191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:58.889125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:58.889125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:58.889125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:58.889125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 359/691] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:58.894921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.899339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 333/692] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:58.907886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.982082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.014679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3717f1-b4e7-46af-b537-915f2c78851c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.030239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.063052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.065728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.066003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.066271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.066925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:59.067230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.068657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.080339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6b5a7-4d6e-4d5c-99a1-e703b81718ef None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.087429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 360/693] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:59.089067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.122731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.123402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.123675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.123936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.132473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.134018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:59.147698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:59.148783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:44:59.149741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 334/694] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:59.156529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.209214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214b17-ca3c-438f-982e-249bdb01ee6f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.246082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.246728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.247006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.247273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.258116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.259578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.267347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-90f69005-34c1-4199-8314-fde94842b7a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:59.272680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:59.273730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:59.274613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 361/695] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:59.275773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb005b-8a82-4aa2-a157-9e0327529d38 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.276058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb005b-8a82-4aa2-a157-9e0327529d38 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.276327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb005b-8a82-4aa2-a157-9e0327529d38 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.283501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9f3ce-49e9-4137-9abf-b36c33e3ff3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.283703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 362/696] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:59.284505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb005b-8a82-4aa2-a157-9e0327529d38 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.328476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.332769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.333673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.334248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.335022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.336140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:59.336594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.338761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31bcc4-f7cf-4fa1-8d87-9f36c759e9de None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.364648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 335/697] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:59.366438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.366981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.367448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.387457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:59.389206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:59.410158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb005b-8a82-4aa2-a157-9e0327529d38 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.454796 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.455618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.456111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.456455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.457321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:59.457729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.460041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.467601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 336/698] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:59.468921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.485455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 363/699] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:59.492949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.605345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.653022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.655394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472cac0-f4cc-4a59-8cfa-e8e3c054cabd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.682237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ddf20-0e71-4c99-a6ae-18cf97f56f9a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.731667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a196e-bbdd-44d0-acd6-11833fbc63ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.732292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a196e-bbdd-44d0-acd6-11833fbc63ca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.732575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a196e-bbdd-44d0-acd6-11833fbc63ca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.732999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a196e-bbdd-44d0-acd6-11833fbc63ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.753056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.754012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.754475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.754961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.755871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=060c831449d541a28a826628ac472ebd) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:59.756374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.758105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.768187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 364/700] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/role_assignments?user.id=060c831449d541a28a826628ac472ebd&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:59.793873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.850123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a196e-bbdd-44d0-acd6-11833fbc63ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.852395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a196e-bbdd-44d0-acd6-11833fbc63ca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.916912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f3912-88b3-4e23-9b83-225ed9b7371c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.954710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.955615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.956029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.956432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.963475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.971059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.972939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.994069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 337/701] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:59.994265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:59.995149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:59.996144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:59.996144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:59.996144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:44:59.996313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71db1e-6e66-425b-902f-2e0f12df0ef9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.996313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71db1e-6e66-425b-902f-2e0f12df0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.996313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71db1e-6e66-425b-902f-2e0f12df0ef9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.996489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 365/702] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:59.997103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 338/703] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:59.998341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.998446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.998782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.998939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.001996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.018888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:00.020035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:00.106881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 339/704] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:00.106881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.125831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f8b58-aaaa-45d6-b5d3-758c0e019b1a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.164759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.165402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.165680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.165949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.268468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296561f3-632a-4d05-8dcb-69041764a63f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.280969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.320042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.320721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.321002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.321273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.321951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:00.322251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.323679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.336578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 340/705] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:00.342300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.358323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.359873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:00.375862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:00.376903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:00.377833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:00.377833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:00.377833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:00.377833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 366/706] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:00.382934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.456989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.483188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7c2b-4eb9-4678-b411-4ee0c1b32364 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.527938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14118295-a26c-4d0f-bfc5-4aecfbb69113 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.533310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.534165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.534637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.535100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.535995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.538204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.568503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 341/707] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:00 2022] POST /identity/v3/users => generated 254 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:45:00.569762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.572845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.573605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.573948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.574220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.575546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:00.575546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.581938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c74195-82d6-4df4-b21a-dc90726242da None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.604534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.606958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 367/708] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:00.612696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7b1e-58e3-420c-80a4-3f922af756bc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.612941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7b1e-58e3-420c-80a4-3f922af756bc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.613150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7b1e-58e3-420c-80a4-3f922af756bc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.614693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 368/709] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:00.619667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7b1e-58e3-420c-80a4-3f922af756bc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.702553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590288a-165b-46f2-ba21-083a128f5586 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.742637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.743791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.744297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.744847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.745670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.747305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.757731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7b1e-58e3-420c-80a4-3f922af756bc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6e505397-536a-488e-8a94-bad07f164ddb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:00.760583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:00.761663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:00.762510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:00.765529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 342/710] 10.222.0.65 () {56 vars in 1129 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:00.767167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.767648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.768148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.774024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.789797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:00.790970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:00.802567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531021f-9815-475a-ac53-44229c576166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.802777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531021f-9815-475a-ac53-44229c576166 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.803051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531021f-9815-475a-ac53-44229c576166 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.803318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531021f-9815-475a-ac53-44229c576166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.813429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531021f-9815-475a-ac53-44229c576166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.814864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531021f-9815-475a-ac53-44229c576166 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-6531021f-9815-475a-ac53-44229c576166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:00.831256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:00.832222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:00.833180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:00.834189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 369/711] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:00.835012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531021f-9815-475a-ac53-44229c576166 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.877971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 343/712] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:00.879059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.907199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.942022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531021f-9815-475a-ac53-44229c576166 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.975568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.976191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.976463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.976760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.977400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:00.977693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.979058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.984086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 370/713] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:00.991140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.003757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d0ad9-f4ef-4d66-b579-afd935ea80ee None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.035407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.052181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.052945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.053320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.053979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.054466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.054861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.056440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.069259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 344/714] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:01.075016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.131072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be95a-662f-496c-8aa9-723c3d2583d3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.167184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.168055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.168420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.168840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.169565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.169957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.171513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.178289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 371/715] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:01.228061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.263746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f829da-0990-4610-94fc-8d89db184493 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.314129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.315009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.315437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.315854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.316784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=3a919420853a4ac8b461e303fc993429) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.317240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.318856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.326035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 345/716] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/role_assignments?user.id=3a919420853a4ac8b461e303fc993429&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:01.355339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.503021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ca27f-2251-46e3-adee-197196bdb200 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.504805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.542696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.543341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.543618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.543891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] PATH_INFO: `/v3/services/network` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.544476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.545873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:01.557033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:01.558054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:01.558939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 372/717] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:01.566551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.708225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8181b-1e05-404f-8780-717bf5ffc07a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.751407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.752405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.752912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.753459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.754382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] RBAC: Adding query filter params (name=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.754877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.756436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdafb2-756b-45f5-a345-e68a5359cedd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.764250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 346/718] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:01.770045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.915171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd93e00-c01c-46c4-ba8a-8b7355ec1e4a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.958912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.959525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.959863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.960139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.960860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] RBAC: Adding query filter params (type=network) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.961159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.962523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9df1c4-ab3a-4ca0-81c8-2ac914ebbadf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.967398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 373/719] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:02.318601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e76ef-40c4-41b7-932c-1739a5025edb None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.319163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e76ef-40c4-41b7-932c-1739a5025edb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.319163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e76ef-40c4-41b7-932c-1739a5025edb None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.320752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 347/720] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:02.326161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.326581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.326801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.346611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:02.347808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:02.372975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:02.424441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 374/721] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:02.776334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e76ef-40c4-41b7-932c-1739a5025edb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:02.785929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:02.909299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e76ef-40c4-41b7-932c-1739a5025edb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:02.951366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:02.952008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.952286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.952555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.968252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:02.973740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:02.974743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:02.975596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 348/722] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:02.982188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:03.135474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb541f2-5045-4476-b6a3-b8b17dfca7b0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:03.183115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:03.183725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:03.183999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:03.184266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:03.184987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:03.185282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:03.186640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:03.200700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 375/723] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:03.206737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:03.276278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:03.311005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043dc3-f832-495b-914b-5eec4251875b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:03.344875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:03.345493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:03.345768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:03.346026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:03.356671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:03.358156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9ed09a67-490b-4a97-9968-7bc7972e45d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:03.372952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:03.373990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:03.374891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:03.374891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:03.374891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:03.374891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 349/724] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:03.381383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:03.426028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:03.534349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f4bc-ff72-4693-a82e-1bdace4f85db None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:03.535261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f4bc-ff72-4693-a82e-1bdace4f85db None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:03.535877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f4bc-ff72-4693-a82e-1bdace4f85db None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:03.537727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 350/725] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:03.540052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f848-4ebb-4df7-9db8-265a105e34be None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:03.543519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:03.543800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:03.544066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:03.583418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:03.584626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:03.587627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:03.588243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:03.588510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:03.588799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:03.589440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:03.589731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:03.591081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:03.612238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 376/726] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:03.618820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:03.708147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 351/727] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:03.745414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:03.775046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fbedd-dd5b-4c4a-bd12-4c3a1a6048ba None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:03.817262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:03.817895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:03.818173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:03.818442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:03.831627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:03.833130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:03.847790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:03.848763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:45:03.849722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:03.853572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 377/728] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:03.857719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:03.938072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.009902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf89f-7dbc-41b5-b977-f6d5af658dfe None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.061877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.062497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.062843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.063110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.063843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.064146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.065618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41098d90-ccca-48fd-9dd4-76642525cc7a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.092367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 352/729] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Sep 13 19:45:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:04.098233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.113947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db453-4f45-4896-8af1-35d0fa9537c6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.114257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db453-4f45-4896-8af1-35d0fa9537c6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.114487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db453-4f45-4896-8af1-35d0fa9537c6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.116092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 353/730] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:04.140090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.140451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.140739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.163227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:04.164410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:04.210419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80647f1a-5af5-40d1-aefe-2dfa82ac82d7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.241447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 354/731] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:04.245579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.245696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6021b-c028-41bc-b344-58ae052a1e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.246313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6021b-c028-41bc-b344-58ae052a1e43 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.246583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6021b-c028-41bc-b344-58ae052a1e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.246858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6021b-c028-41bc-b344-58ae052a1e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.261748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.293026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.327508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6021b-c028-41bc-b344-58ae052a1e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.329465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6021b-c028-41bc-b344-58ae052a1e43 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.357153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f41b-1d45-44a8-b90b-2818f4a360fa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.394138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d93ad-2192-4880-b131-33675f6a86a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.394780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d93ad-2192-4880-b131-33675f6a86a0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.395057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d93ad-2192-4880-b131-33675f6a86a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.395326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d93ad-2192-4880-b131-33675f6a86a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.408878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d93ad-2192-4880-b131-33675f6a86a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-448d93ad-2192-4880-b131-33675f6a86a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:04.415733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:04.416968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:04.418117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:04.425888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 355/732] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:04.427288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4379-5ff4-4bd0-9591-c3c0a2237fcd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.427574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4379-5ff4-4bd0-9591-c3c0a2237fcd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.427851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4379-5ff4-4bd0-9591-c3c0a2237fcd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.432805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 356/733] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:04.434679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4379-5ff4-4bd0-9591-c3c0a2237fcd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.450830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 378/734] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:45:04.453077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.453655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.454122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.474257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:04.475818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:04.514373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.548170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.549888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 379/735] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:04.550977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.555975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4379-5ff4-4bd0-9591-c3c0a2237fcd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.594533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.595149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.595429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.595696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.596361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.596804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.598193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.606602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 357/736] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:04.607381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.669926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a51ec-0919-42ad-a3bf-f57f33795601 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.704304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.704966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.705247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.705516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.710654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546facb5-e1b5-4e6f-be4d-f0da11dd5b32 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.715389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.716850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a74692bc-81e9-4243-aefd-d423a5b9e581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:04.731698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:04.732937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:04.734155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:04.734155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:04.734155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:04.734155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 380/737] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:04.734433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32753894-7f36-4c3e-babb-15126e5b7519 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.734639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32753894-7f36-4c3e-babb-15126e5b7519 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.734842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32753894-7f36-4c3e-babb-15126e5b7519 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.736198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 381/738] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:04.740727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32753894-7f36-4c3e-babb-15126e5b7519 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.752110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.752777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.753049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.753318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.763447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:04.767249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:04.768680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:04.769640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:04.770466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 358/739] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:04.771449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.790667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.850806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32753894-7f36-4c3e-babb-15126e5b7519 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.871198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60992c4-5103-4abc-a9d8-acf59d51af48 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.884920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.885555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.885830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.886096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.896107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.897578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.903869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.904572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.904881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.905149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.905797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.906120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.907510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f7d829de-6494-4498-85d9-2a2d94831666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:04.911869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:04.912999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:04.913896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:04.913896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:04.913896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:04.913896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 382/740] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:04.914130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.914431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.914684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.919988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 359/741] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:04.920879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.935668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:04.936897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:04.996101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.006046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 383/742] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:45:05.006853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.020432 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b18d7a-d7b9-49b6-bb44-a4b6495622bf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.022508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.055717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.056361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.056659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.056934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.057594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.057914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.059278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.067110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 360/743] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:05.067880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.122268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5cfd8-1321-481e-8eae-9169435e2c39 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.164856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.165468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.165762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.166014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.166668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.168212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.178433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f565f88-6aa1-49cf-9f9d-66ec2febe34b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.186626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 384/744] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:05 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:05.187762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.237929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.238549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.238822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.239087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.239735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.240029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.242111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.245452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.264543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 361/745] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:05.266601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.295104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.336564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090819-e052-41c1-bafa-05afb486dc7e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.373321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.373656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.373962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.374155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.381918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.383189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b968bf-50f4-4102-b848-dbf362f28ff6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.383636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:05.395713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:05.396733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:05.397930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 385/746] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:05.398420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.420655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.421311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.421591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.421861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.434532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.436146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:05.456039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:05.457171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:05.458052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:05.458052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:05.458052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:05.460715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 362/747] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:05.461518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.508203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f3b76-21b1-486d-b539-42cb7272a26a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.510780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.534595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.544148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.544884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.545215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.545441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.553158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.554640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:05.566548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:05.567492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:05.568426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:05.569024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff682490-746a-4db2-9317-f600d25e935d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.569101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 386/748] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:05.569101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.608729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.609707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.610010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.610235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.610895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.612671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.629879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 363/749] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:05 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:05.630986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.694348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5605-ff91-4fc7-aa9b-536550167b32 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.764858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.765934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.766387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.766825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.766983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc604e5-7c3b-4eef-a70c-ef7749d9f985 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.767868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.768348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.771355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.778562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.789072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 387/750] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:05.790251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.814886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.815564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.815845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.816114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.817152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.817459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.818868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.833071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 364/751] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:05.833989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.854623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.937256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848592f-36ec-4b27-a70a-d62504bc34c3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.954367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a46e0a-bdf9-4b4e-ae6d-684b13ecabca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.978818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.979791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.980266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.981204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.982433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.982945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.984642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.997780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.998402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.998677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.998948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.999729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=060c831449d541a28a826628ac472ebd) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:06.000068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:06.001548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:06.011062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 388/752] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:06.011062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.014105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 365/753] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/role_assignments?user.id=060c831449d541a28a826628ac472ebd&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:06.015221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.133122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:06.134026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:06.136724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920cbec-1751-4a11-b358-a27bca1700f0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:06.181879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:06.183633 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:06.184077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:06.185432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:06.203632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:06.205441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:06.221819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:06.222826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:06.223771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:06.227384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 389/754] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:06.236002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.262293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c8e8e-155b-4af7-8934-5a60ef62eb33 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:06.306224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:06.307315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:06.307593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:06.308290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:06.416705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f6647-1e92-408c-986b-8d4b0607e264 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:06.446286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:06.448772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:06.477853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:06.478466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:06.478742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:06.479008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:06.479847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:06.480157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:06.481684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:06.502080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 390/755] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:06.510792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.514906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:06.565730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:06.586450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 366/756] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:06.592106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.750167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765c23b-3fbb-4b78-9647-7b50152de05b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:06.753528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de10c4-334e-44ea-af90-157a871aae57 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:06.789876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3165-4228-487e-a659-973460af7105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:06.790517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3165-4228-487e-a659-973460af7105 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:06.790795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3165-4228-487e-a659-973460af7105 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:06.791064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be3165-4228-487e-a659-973460af7105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:06.801753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3165-4228-487e-a659-973460af7105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:06.803211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be3165-4228-487e-a659-973460af7105 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-87be3165-4228-487e-a659-973460af7105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:06.819131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:06.820118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:06.821069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:06.821069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:06.821069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:06.821069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 391/757] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:06.826973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:06.828085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3165-4228-487e-a659-973460af7105 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.842086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:06.842734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:06.843012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:06.843283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:06.865168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:06.866634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:06.902198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:06.903206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:06.904099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:06.904099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:06.904099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:06.914040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 367/758] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:06.918659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:06.932091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:06.965985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be3165-4228-487e-a659-973460af7105 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.003430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.003963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.004244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.004517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.005340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:07.005641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.007132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.020950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 392/759] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:07.027269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.140008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098545c-c7f5-4ad1-abc5-a696ff050c58 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.172863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.180029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.180978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.181324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adac01-e254-4c6d-9ede-3b0f30dbc11b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.181712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.182177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.191254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.193034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:07.206062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:07.206963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:07.207845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:07.210516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 393/760] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:07.219832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.261949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.262492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.262770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.263039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.263685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:07.263983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.265748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.294936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 368/761] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:07.300485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.334144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80840a30-c01d-4074-9772-7a25f7494bff None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.372600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.373817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.374298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.374769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.375688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:07.376201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.378365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.393025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 394/762] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:07.401567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.407219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.482219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7d62-6c64-4ce7-b3dd-870785f29766 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.486104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.519626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.520164 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.520435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.520735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.529409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.531723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.544537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31af9-8819-4ee7-b575-e52eb8a103f1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-959d5045-66fa-48c5-964a-4509053d7b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:07.545910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:07.546767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:07.547692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 369/763] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:07.548605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51591ba2-f87f-4bee-8c50-6645bb3c9eda None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.548912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51591ba2-f87f-4bee-8c50-6645bb3c9eda None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.549184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51591ba2-f87f-4bee-8c50-6645bb3c9eda None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.554608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 370/764] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:07.554608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51591ba2-f87f-4bee-8c50-6645bb3c9eda None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.600126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09cadf-2a14-4a90-8c2f-e12e4624dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.600845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09cadf-2a14-4a90-8c2f-e12e4624dda0 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.601123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09cadf-2a14-4a90-8c2f-e12e4624dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.601395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09cadf-2a14-4a90-8c2f-e12e4624dda0 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/3a919420853a4ac8b461e303fc993429/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.603297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09cadf-2a14-4a90-8c2f-e12e4624dda0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=3a919420853a4ac8b461e303fc993429, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.604755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09cadf-2a14-4a90-8c2f-e12e4624dda0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.622618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 395/765] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:07 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/3a919420853a4ac8b461e303fc993429/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:07.623909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.624197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.624470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.658650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:07.659918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:07.723900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51591ba2-f87f-4bee-8c50-6645bb3c9eda None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.733008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.790661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.792277 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.792933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.793209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.793917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:07.794224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.795993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.806222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 396/766] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:07.820647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 371/767] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:07.826546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.880709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.939663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1186e-0414-4c20-bc02-eed03eb9bbf3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.975154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.975723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.976060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.976335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.977099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=7341e345e620445583169f35d05deddc) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:07.977409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.978840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462da4dd-e263-4ad6-935e-6dc920a9fea2 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.984868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 397/768] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/role_assignments?user.id=7341e345e620445583169f35d05deddc&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:08.088238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.135868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f071c9-b6db-461d-b73d-f571d9573f96 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.136241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f071c9-b6db-461d-b73d-f571d9573f96 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.136425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f071c9-b6db-461d-b73d-f571d9573f96 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.137852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 398/769] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:08.154824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.155170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.155369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.192833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:08.194036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:08.214704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52c03f-b0f0-4975-bd16-447c39c3abf6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.260489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.261791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.263182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.263685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.264474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.266222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:08.278251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:08.279288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:08.280122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:08.282227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 372/770] 10.222.0.65 () {56 vars in 1129 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:08.289978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.308228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 399/771] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:08.330347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.415094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bc69-646c-4cf7-b632-775813f39430 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.448203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.448992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.449270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.449534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.450158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:08.450456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.451829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.456570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 373/772] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:08.462320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.520571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.619960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3984b1-90e3-4cbd-9d6e-c0e485a59f54 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.674884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.675425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.675703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.675968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.676606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:08.676930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.678341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.689488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 400/773] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:08.695182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.727685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.846572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.853323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.858608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05171b75-c385-45c2-ad46-fa8fefa58138 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.863616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50be8f3-e4bb-415a-85fa-1517c1fb0c19 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.902941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.903631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.903905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.904169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.904901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] RBAC: Adding query filter params (interface=public, service_id=3093463af10e4f8eafe82c8ca51ff2d6, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:08.905199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.905630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.906582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.906686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd431b-1a6a-4cac-8793-063bd91b90d2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.907136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.907590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] PATH_INFO: `/v3/services/network` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.908674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.910237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.920905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 374/774] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/endpoints?service_id=3093463af10e4f8eafe82c8ca51ff2d6&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-53b0dfe6-73c0-4d14-9c5a-b584bfc7fc06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:08.921425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:08.922458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:08.923294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:08.924023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329c63-90f1-4327-973e-c7f72f721bad None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.924023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329c63-90f1-4327-973e-c7f72f721bad None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.924023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2329c63-90f1-4327-973e-c7f72f721bad None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.926312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 375/776] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:08.926537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 401/776] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:08.926945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329c63-90f1-4327-973e-c7f72f721bad None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.933627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.934149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.934687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.955106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:08.956707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:09.031917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 402/777] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:09.032818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:09.052265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2329c63-90f1-4327-973e-c7f72f721bad None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.100326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.101385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.102116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.102592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.104009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:09.106203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:09.113855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 376/778] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:09.148045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:09.159487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb125a-a165-4178-8784-7d123d261525 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.197917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.198453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.198723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.199044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.199683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:09.200043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:09.201630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:09.207175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 403/779] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:09.212876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:09.237581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:09.355218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527ebe5-3391-4c7a-82c1-46776575daaf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.393915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.394531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.394845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.395114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.395740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] RBAC: Adding query filter params (type=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:09.396033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:09.397484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:09.404123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 377/780] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:09.410165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:09.413423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:09.536299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:09.542329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fad9-13e9-4ac7-be6a-a7b47122b4a7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.557729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927fffb-6bb7-49bb-b7a9-356152abaa6e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.588253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.589262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.589736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.590223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.591001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] RBAC: Adding query filter params (interface=public, service_id=a1d89fe57b6e49dfb957b2d04e5c4fc5, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:09.591373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:09.596643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:09.606417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 404/781] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/endpoints?service_id=a1d89fe57b6e49dfb957b2d04e5c4fc5&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:09.607962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.608632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.608920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.609235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.610963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:09.632237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:09.640024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:09.641080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:09.641939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:09.642575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 378/782] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:09.648873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:09.656922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:09.806266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36cb82-bb43-4ca9-a00a-95ddeb589386 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.827671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7cc02-cee2-4621-95e4-01f44207248c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:09.870945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.871572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.871842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.872113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.872764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:09.874143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:09.883300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 405/783] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/services => generated 772 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:09.904719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:09.905434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:09.905702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:09.905971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:09.906808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:09.907092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:09.908512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:09.928497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 379/784] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:09.934289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.049565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.068198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37ff1-53eb-41c3-aeb7-6969b7f86498 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.104449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:10.105192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.105471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.105741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.118488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:10.119960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:10.135091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:10.136066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:10.136980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:10.136980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:10.136980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:10.136980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 406/785] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:10.142166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.154586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.280256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58617997-533d-4cd3-982a-1b4636d4a9a6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.335993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:10.336969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.337425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.337895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.338767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:10.339244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:10.340875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195847f-9283-4175-82f6-46a72eb6549f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:10.360422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 380/786] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:10.366691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.409953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2764-8f5d-4487-a10d-a9c59ee32727 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.410472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2764-8f5d-4487-a10d-a9c59ee32727 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.410885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee2764-8f5d-4487-a10d-a9c59ee32727 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.412354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 381/787] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:10.417383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ef5b-554c-4e29-8394-823f22ac0dd3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.417661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ef5b-554c-4e29-8394-823f22ac0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.417927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47ef5b-554c-4e29-8394-823f22ac0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.439330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ae47ef5b-554c-4e29-8394-823f22ac0dd3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:10.440535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ae47ef5b-554c-4e29-8394-823f22ac0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:10.521649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42421c6-9bfc-40f9-9f68-3e34a06b5163 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.532975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.543455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 382/788] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:10.545179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3910a-6b18-45fd-be7b-50ca1b0ef860 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.545606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3910a-6b18-45fd-be7b-50ca1b0ef860 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.546040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3910a-6b18-45fd-be7b-50ca1b0ef860 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.551664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 383/789] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:10.553561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.553996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.554409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.574430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:10.575885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:10.581216 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:10.582033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.582313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.582576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.588293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.600773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:10.602454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:10.628221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:10.629479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:10.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 407/790] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:10.635358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.675509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 384/791] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:10.788281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc82f9-2785-41ee-a659-443e77debc65 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.825843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:10.826745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.827120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.827498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.828728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:10.829233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:10.831555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:10.850767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 408/792] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Sep 13 19:45:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:10.854200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.856147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.963209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97457e8-0476-40f0-8251-52487d3318c9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.986482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.994605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.005690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.006652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.006937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.007208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.020356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:11.027017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.027945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 385/793] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.029443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.052486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d572c-76ee-4f04-8ce1-8e1190fe9745 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.092142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.093226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.093703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.094245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.105519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.107302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:11.123535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.124509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:11.125479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:11.125479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.125479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:11.127571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 409/794] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:11.128553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.169009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656dcc0-b740-46f0-af08-d96c4d1dbca3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.215628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.216308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.216598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.216887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.230097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:11.233952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f24a9-89bd-4b07-b4c8-cdafa32c85a1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:11.235353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.236246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:11.237489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:11.239736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 386/795] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.240774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.241652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.279705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.280371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.280674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.280946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.281758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.282068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.283511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.296721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 410/796] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:11.298998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.302280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.357455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2b859-effb-4aec-9dbe-f201c7053c7b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.393247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.393862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.394135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.394404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.395557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.395921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.397597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.417677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 387/797] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:11.418602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.431901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdae1f-05d5-431b-870a-df133aab2c88 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.468311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.469034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.469315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.469583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.470248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.470545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.471905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.481286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 411/798] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:11.482120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.514742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.561453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c88415-9d4f-47fa-a8f0-4cd7c0ee4c27 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.569000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.591893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40f54a-6870-468a-9a4a-57d473e45f07 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.598389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.599205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.599654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.600109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.613673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.615438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.630136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.630852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.631195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.631530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:11.635868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.637024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:11.638218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:11.638218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.638218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:11.640271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 388/799] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.640386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.641436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.642452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:11.654687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.655790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:11.656973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:11.658477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 412/800] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.659284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.756213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.767581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e78d-edbc-4c0b-9042-56c42617271b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.776146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3b544-d966-4da9-ac89-ec776fe8564e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.804051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.804730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.805152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.805489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.806277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.806640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.808179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.822828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 413/801] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:11.824041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.826996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.828294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.829350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.829350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.847083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.849682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:11.869010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.870431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:11.871321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:11.871321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.871321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:11.871321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 389/802] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.871551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.885023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.947669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a438a-c23b-4c97-adcb-fbad5d8614a0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.984133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.984816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.985098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.985368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.985607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21a729-eb6c-49db-bea1-3b917caf47d3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.986058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.986359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.988137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.999979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 414/803] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:12.000901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.015033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.029403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.030046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.030337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.030596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.038357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.039805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4b091514-adfd-4720-ae4a-3b975b4e58c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:12.051006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:12.051964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:12.052940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 390/804] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:12.053879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27876991-052f-435e-a666-529aff3daf65 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.053879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27876991-052f-435e-a666-529aff3daf65 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.053879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27876991-052f-435e-a666-529aff3daf65 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.055180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 391/805] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:12.055715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27876991-052f-435e-a666-529aff3daf65 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.118383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b55edf-75da-4c88-970b-23a6101076e3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.130806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.156895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.157607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.157889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.158263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.158907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.159257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.160702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.162187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27876991-052f-435e-a666-529aff3daf65 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.173948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 415/806] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:12.175080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.198702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d6254-3a8c-4cb0-957c-1ec0b57afdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.199381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6254-3a8c-4cb0-957c-1ec0b57afdc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.199656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6254-3a8c-4cb0-957c-1ec0b57afdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.199923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6254-3a8c-4cb0-957c-1ec0b57afdc9 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/060c831449d541a28a826628ac472ebd/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.201845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d6254-3a8c-4cb0-957c-1ec0b57afdc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=060c831449d541a28a826628ac472ebd, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.203352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d6254-3a8c-4cb0-957c-1ec0b57afdc9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.216886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 392/807] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:12 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/060c831449d541a28a826628ac472ebd/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:12.218265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.218534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.218834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.246350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:12.247466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:12.266367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.316107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760d1a6-1cf7-4213-b161-4b8d00697021 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.344863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 393/808] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:12.344863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.396431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.398502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.398784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.399055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.400717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.401025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.402519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.432192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 416/809] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:12.436213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.453693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.509967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd4f91-945d-4b21-ab1b-47333ebbaba7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.557714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.558354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.558463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45400975-17d7-417f-bc98-47e127c9c86f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.558627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.558895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.567967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.570290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-7a9fb83a-ef25-4725-9881-5a11eb2a24f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:12.585802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:12.586767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:12.587697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:12.588239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.589561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 394/810] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:12.590342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000722ce-285a-4fb9-bdef-ee0c390f7fcb None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.590932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000722ce-285a-4fb9-bdef-ee0c390f7fcb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.591326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000722ce-285a-4fb9-bdef-ee0c390f7fcb None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.593797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 395/811] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:12.594522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000722ce-285a-4fb9-bdef-ee0c390f7fcb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.600632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e067607-9582-474e-9072-49c984348da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.601345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e067607-9582-474e-9072-49c984348da4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.601625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e067607-9582-474e-9072-49c984348da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.601895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e067607-9582-474e-9072-49c984348da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.613916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e067607-9582-474e-9072-49c984348da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.615547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e067607-9582-474e-9072-49c984348da4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-9e067607-9582-474e-9072-49c984348da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:12.634930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:12.635926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:12.637470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:12.637470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:12.637470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:12.637470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 417/812] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:12.637726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.637988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.638260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.658241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:12.659202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:12.721186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000722ce-285a-4fb9-bdef-ee0c390f7fcb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.726421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 418/813] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:12.727265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.750946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.766484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.767470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.767942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.768485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.769534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.770032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.771902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.790149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 396/814] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:12.791087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.849813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d574b-40d7-47fa-ac8a-0a33da0ece1b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.861789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.890827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.891727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.892152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.892564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.893366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.893809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.895317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.907489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 419/815] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:12.908529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.911584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71a6d-900a-438b-bdba-a00add67af27 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.947257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.947895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.948169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.948443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.949067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.950434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:12.959806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:12.960903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:12.961776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 397/816] 10.222.0.65 () {56 vars in 1129 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:12.962575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.017316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51fae8-960a-4cb8-bee7-edb55641484f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.025235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.056340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.057336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.057844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.058292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.066799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4be06-d592-4eb6-bc1f-4edb26b5ff86 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.099847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.100469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.100774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.101041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.102644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.108226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.110264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:13.121995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:13.123068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:13.124092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 398/817] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:13.128684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.141256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.142699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.235658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7f67d-46a0-449a-bc99-8008c46fb546 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.237974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.260456 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 420/818] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:13.260456 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.272113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.272755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.273044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.273284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.273919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.274214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.275585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.280116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 399/819] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:13.280907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.337202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.371301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbf19-389c-48fa-916b-17da3019d4d7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.381032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c97b2-57a7-4962-a29c-e8fcad6230ef None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.407693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.408431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.408735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.409093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] PATH_INFO: `/v3/services/network` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.409683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.411043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.413834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.414441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.414716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.414978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.415667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.415964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.417386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:13.421099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:13.422163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:45:13.423045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:13.425253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 421/820] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:13.426193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.434987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 400/821] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:13.435802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.467542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.543184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5af04a-462c-4f77-b4de-89b65784a0e3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.545676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091c229-55da-4302-bfa7-c9f8c3645477 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.578388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.579367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.579793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.580212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.580606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.581181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.581314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.581524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.581788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.582028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.583631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.583760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.594303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 401/822] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:13.594303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.594557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.594557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:13.611275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:13.612683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:13.613646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:13.613646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:13.613646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:13.613646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 422/823] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:13.613646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.691801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.702620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb560b-8082-48d6-9e41-8417f5776f10 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.725489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4155-9afd-4b45-a628-e6c92a1500a1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.739754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.740779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.741058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.741332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.741954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] RBAC: Adding query filter params (name=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.742251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.743621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.748652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 402/824] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:13.748783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.766994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.767655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.767928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.768197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/7341e345e620445583169f35d05deddc/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.784530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=7341e345e620445583169f35d05deddc, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.785989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.801784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 423/825] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:13 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/7341e345e620445583169f35d05deddc/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:13.802508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.852313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.875023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e8a6b-3edb-4827-8957-51c82c1aa464 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.924522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.926732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.927444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.927950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.929439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.930855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.948462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6670c644-f0b8-4d35-bd14-f6ab33ba49f4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.967323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 403/826] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:13.967323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.992522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.028771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.029412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.029732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.030057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.030648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:14.030952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.032550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.050837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 424/827] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:14.054799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.160569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aba95a-78ed-4122-b7c4-475f1ee766a4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.200342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.201139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.201387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.201653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.202285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] RBAC: Adding query filter params (type=network) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:14.202583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.204229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.210631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 404/828] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:14.211264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.217606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.222043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd5b38-f43a-4e0a-9529-a5fa9e187695 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.262551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.263211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.263583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.263862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.271357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.272971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:14.286436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:14.287378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:14.288340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 425/829] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:14.293668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.313182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.345936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067510-79ae-4439-a55b-16d67420be3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.404656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.405661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.406133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.406729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.407649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.414077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.457370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 405/830] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:14.476038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62b4d-dd15-4e45-8915-d1a4c8ac78cd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.535054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.535676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.535950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.536215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.537003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:14.537360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.538863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356459d3-be14-495b-aa22-c814a9ea86dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.559242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 426/831] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:14.565675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.623329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fca720-888e-46a4-8efb-81909f235c93 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.623676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fca720-888e-46a4-8efb-81909f235c93 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.623881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fca720-888e-46a4-8efb-81909f235c93 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.625671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 427/832] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:14.635568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.636167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.640659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.658749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:14.659974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:14.663531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.720227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d89a4-983f-46af-b997-236d1ae19f2b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.762173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.764040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 428/833] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:14.772039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.772703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.773208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.773714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.774606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=3a919420853a4ac8b461e303fc993429) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:14.775060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.777051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.784555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 406/834] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/role_assignments?user.id=3a919420853a4ac8b461e303fc993429&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:15.049573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.152115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392dd3e-d417-4dd0-a890-077b02b8bf19 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.186189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.187096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.187536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.188070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.197719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.201125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:15.206405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:15.207336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:15.208181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:15.210459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 429/835] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:15.220643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.316014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfd077-3326-4185-89bc-8e5cd8c4633e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.350252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.350866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.351302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.351577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.352241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:15.352536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.353926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.363262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 407/836] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:15.369365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.476005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1e05-f56d-461f-8000-aad3c5442547 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.511662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.512300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.512580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.512882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.523320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.524796 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:15.539755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:15.540758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:15.541876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:15.541876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:15.541876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:15.541876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 430/837] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:15.548234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.603383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.648151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc272a9c-9ede-4251-8580-7f49020217db None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.681752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.682755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.683228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.683686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.684504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:15.685066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.686663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.704150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 408/838] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:15.709711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.760495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.813995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16732-4f70-4ad3-93fb-e7d0c4de1517 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.848234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.848900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.849179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.849448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.857172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.858553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:15.870083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:15.871017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:15.872207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 431/839] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:15.879219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.983027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36b9a-3372-4178-b696-2cdea68a676d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.000211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.019028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.019756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.020034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.020348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.021089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:16.021392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.022850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139223af-bc5b-4037-844f-b01a036780aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.041635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 409/840] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:16.047928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.150944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7faa91-d819-46a3-a3e8-448bb4eebfdf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.161684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.186697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.187344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.187692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.187946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.259917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.261395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.312042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522360-d3dd-44ce-bf5d-2c8f074e80e9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.313098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522360-d3dd-44ce-bf5d-2c8f074e80e9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.313589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98522360-d3dd-44ce-bf5d-2c8f074e80e9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.316792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 410/841] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:16.321885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fffeb0-d4c4-4932-bb38-5aeeb5aaf35d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.322515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fffeb0-d4c4-4932-bb38-5aeeb5aaf35d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.322972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fffeb0-d4c4-4932-bb38-5aeeb5aaf35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.345064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-50fffeb0-d4c4-4932-bb38-5aeeb5aaf35d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:16.347269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-50fffeb0-d4c4-4932-bb38-5aeeb5aaf35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:16.373351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 432/842] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:16.379899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.393011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.436683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 411/843] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:16.436683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2760-f6d0-42d8-9b72-b0a5ba70f750 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.436683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2760-f6d0-42d8-9b72-b0a5ba70f750 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.436683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2760-f6d0-42d8-9b72-b0a5ba70f750 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.436683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 412/844] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:16.446616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.446616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.446616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.460725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:16.461950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:16.503143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734c3bb-d028-4332-83b9-d2ee2f92e122 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.535328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 413/845] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:16.540079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.540823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.541097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.541364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.551967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.553407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:16.568742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:16.569714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:16.570601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:16.570601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:16.570601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:16.574544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 433/846] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:16.575919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.619619 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.681575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9938e-699d-4adb-a682-0a06acaa7706 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.717163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.717359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.717892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.718172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.718546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.719300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:16.719603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.721001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.744706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 414/847] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:16.747972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.791390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.839879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9de2-f885-473f-87e8-eaa503bdb13e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.860328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.867687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b34f5b-8cce-48ea-976e-bf26658cb520 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.878596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.879509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.879791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.880062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.891601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:16.896871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:16.897834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:16.898669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 434/848] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:16.899365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.907275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.907927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.908197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.908470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.915874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.917367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:16.930300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:16.931238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:16.932125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 415/849] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:16.933045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.015184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738924b2-5d01-4528-8663-71674f2002b6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.041141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.065903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.066550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.066823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.067091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.067675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.069091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.080469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.082193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:17.083570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 435/850] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:17.085770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.173744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f7b3c-2243-4044-9cbc-8ddb40c60241 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.187429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b17d-b27b-4173-a5e6-7fdab5705628 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.206494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.207105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.207381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.207650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.208306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.208602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.210023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.218125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 416/851] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.219007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.219963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.220566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.220874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.221143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.221826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.222852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.223535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5e64a-6e6f-4594-beca-35dd37234e58 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.234900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 436/852] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.236058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced77ba-5fb2-426c-b7f4-e96e2c3999d6 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.236339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced77ba-5fb2-426c-b7f4-e96e2c3999d6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.236630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced77ba-5fb2-426c-b7f4-e96e2c3999d6 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.238164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 437/853] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:17.238842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced77ba-5fb2-426c-b7f4-e96e2c3999d6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.241433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.289025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.317487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb89d2-2f8c-4adb-b7b3-e9c0f907f516 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.343773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced77ba-5fb2-426c-b7f4-e96e2c3999d6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.350139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.350740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.351012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.351273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.351890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.352183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.353564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.357874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 417/854] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.358631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.382420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.383052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.383327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.383593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.393803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.395230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a37e4a7b-518d-4386-8b22-7171bd5147f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:17.410142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.411207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:17.412450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:17.412450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:17.412450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:17.412450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 438/855] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:17.412450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.413140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.413409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.432211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:17.433433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:17.440633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.460636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c02be-a13e-4ff7-b6d0-5aacf14dd7f3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.493034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.493650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.493928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.494227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.494961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=060c831449d541a28a826628ac472ebd) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.495266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.496763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.499142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 439/856] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:17.499971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.520731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 418/857] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/role_assignments?user.id=060c831449d541a28a826628ac472ebd&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.520731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.528055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.616792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd953e7-10e3-49c5-9a67-8806a4e3f45d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.658733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fc149-d40f-46f4-a51b-0ecbc2f88258 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.660961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.661789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.662124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.662461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.663171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.663541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.665044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.675698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 440/858] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.701098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.702113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.702584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.703025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.703938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.704417 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.706046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.720380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 419/859] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.726340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.765418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.769475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.844598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.854671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2a472-c6b3-4534-909c-bb3c880182d5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.888060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30530c1-c337-4529-a12c-6a0d5c48fde8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.891687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.891687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.891687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.891687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.904038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.905617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:17.918305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.919305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:17.920271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 441/860] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:17.925448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.933776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.934412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.934684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.934948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.935525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.936922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.945922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.946986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:17.947875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 420/861] 10.222.0.65 () {56 vars in 1132 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:17.953055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.034052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.060090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81881271-e061-4468-8679-5d3f1c16933e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.072550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6ff90-ff61-488f-a986-09a5d5276036 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.102173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.102792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.103260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.103479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.104208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:18.104822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.107442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.112588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.113238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.113517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.113787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.114417 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:18.114718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.116150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.121301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 421/862] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:18.129256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.133165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 442/863] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:18.138546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.155013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.238855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90063a-7818-472b-be1f-8985733c2b92 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.255307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686227e-045a-45c3-aa4a-16d7f3391603 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.268521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.274353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.274969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.275242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.275507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.276434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:18.276434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.277959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.289078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 422/864] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:18.299860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.300817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.301242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.301661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.381070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.382965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.396903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.497342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 443/865] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:18.504568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.613362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e35e1-4904-4ca3-b8b3-6e699261f03f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.649530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.650111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.650387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.650657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.662247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.663702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:18.678517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:18.679431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:18.681152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:18.681152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:18.681152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:18.681152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 423/866] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:18.685816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.791075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4f2cf-465b-4707-a065-0554ab2086d3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.806187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.830212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.830824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.831097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.831366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.832010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:18.832307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.833689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.845391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 444/867] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:18.850754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.901676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.957612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d17ed-7aa1-477e-a8ab-098ab7b2e0c2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.992670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.993312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.993590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.993857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.000807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.002266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:19.013724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:19.015811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:19.017890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 424/868] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:19.025961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.130232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96caf33-634f-4534-ac3e-e5d2fd1de63c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.163217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.163763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.164045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.164314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.165027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:19.165330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.166750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c012363-2898-4bf9-ae8b-7618a9997090 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.178821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 445/869] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:19.184680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:19.298116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03f37e-e48a-4f5e-b2ab-ad08615205ca None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:19.306922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:19.332537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:19.333171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.333449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.333720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.334434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=7341e345e620445583169f35d05deddc) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:19.334739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:19.336233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d2860-69de-44ab-ae29-3bee594baaa2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:19.342421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 425/870] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:19 2022] GET /identity/v3/role_assignments?user.id=7341e345e620445583169f35d05deddc&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:19.830473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdadaa-b209-4221-a936-03abeb3e152b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.831211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdadaa-b209-4221-a936-03abeb3e152b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.831211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdadaa-b209-4221-a936-03abeb3e152b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.832595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 446/871] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:19.841103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ca13-3fc3-473b-ad8b-e09bbc05067a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.841539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ca13-3fc3-473b-ad8b-e09bbc05067a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.841709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14ca13-3fc3-473b-ad8b-e09bbc05067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.861072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5c14ca13-3fc3-473b-ad8b-e09bbc05067a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:19.862952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5c14ca13-3fc3-473b-ad8b-e09bbc05067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:19.937514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 426/872] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:20.015479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4043-42aa-45bd-87d9-e27151e6d1a4 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.015879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4043-42aa-45bd-87d9-e27151e6d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.016096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db4043-42aa-45bd-87d9-e27151e6d1a4 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.017801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 447/873] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:20.023088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.023372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.023637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.042020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:20.043211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:20.112771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 427/874] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:20.227607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db4043-42aa-45bd-87d9-e27151e6d1a4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.263729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.337713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db4043-42aa-45bd-87d9-e27151e6d1a4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.371676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.372233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.372511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.372815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.373411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.374770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:20.383603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:20.384598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:20.385491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 448/875] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:20.391169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.399197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.432200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.518134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.519400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bdc40-136d-435e-a06c-eb5c1c18fa51 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.527392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951ff1-968e-4d46-820e-35caeefff1fe None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.559475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.560191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.560466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.560763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.561386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.561784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.563093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9221e-6946-4282-8981-658ac0c80d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.563325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0883c5-c4d1-428b-bd52-dda67dd87dfe None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.563699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9221e-6946-4282-8981-658ac0c80d64 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.563975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9221e-6946-4282-8981-658ac0c80d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.564253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9221e-6946-4282-8981-658ac0c80d64 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.565008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9221e-6946-4282-8981-658ac0c80d64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.566365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9221e-6946-4282-8981-658ac0c80d64 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.568026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 428/876] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:20.569402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3d92-b6b9-4318-b04d-f36a953aac61 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.569860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3d92-b6b9-4318-b04d-f36a953aac61 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.570123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d3d92-b6b9-4318-b04d-f36a953aac61 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.571455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 429/877] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:20.576081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d3d92-b6b9-4318-b04d-f36a953aac61 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.585915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 449/878] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:20 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:45:20.587330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.587616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.587886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.608898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:20.610228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:20.704054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 450/879] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:20.712827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.721700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d3d92-b6b9-4318-b04d-f36a953aac61 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.762754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.763383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.763658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.763925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.764560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.765035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.766515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d452ea0-385d-4535-b742-31bbcc12007f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.772182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 430/880] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:20.983828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.066825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.086753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf954482-caf8-4601-8d03-7007c3059021 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.121907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0de39-6c06-4d8e-b8d2-0a0dfbff50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.122907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0de39-6c06-4d8e-b8d2-0a0dfbff50fd None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.123377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0de39-6c06-4d8e-b8d2-0a0dfbff50fd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.123855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0de39-6c06-4d8e-b8d2-0a0dfbff50fd None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.124729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0de39-6c06-4d8e-b8d2-0a0dfbff50fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.126386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0de39-6c06-4d8e-b8d2-0a0dfbff50fd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.144064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 451/881] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:20 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:21.629869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbea74d-2b7c-4c17-bb0f-12538c58b1e5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.631137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbea74d-2b7c-4c17-bb0f-12538c58b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.631137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbea74d-2b7c-4c17-bb0f-12538c58b1e5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.633493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 431/882] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:21.639266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.639553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.639830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.659991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:21.661257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:21.736333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 452/883] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:21.996944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbea74d-2b7c-4c17-bb0f-12538c58b1e5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.104767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbea74d-2b7c-4c17-bb0f-12538c58b1e5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.142167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.142803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.143080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.143348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.155162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:22.160123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:22.161137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:22.163095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 432/884] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:22.167561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.240250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:22.275679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01f21-b863-4d3a-9ef9-65d238b3081a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.310629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.311255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.311538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.311810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.312481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:22.312806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.314175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.323912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 453/885] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:22.330435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.355507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:22.436650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2079db-267a-4f98-a633-3426bdecd7e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.472190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.472863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.473142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.473408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.483688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.485230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:22.500771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:22.503113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:22.504866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:22.504866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:22.504866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:22.504866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 433/886] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:22.507661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.610073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ae256-8982-44d4-be0c-fd0acc618cfb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.637215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:22.645896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.646759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.647272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.647732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.648638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:22.649137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.650688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319548b-385a-483d-a390-09336a0ec563 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.663306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 454/887] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:22.669213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.750809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:22.784377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747194a4-58af-40fd-975f-1b7ba20534b8 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.819667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.820747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.821229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.821717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.827768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558b0e-bce4-416c-9c95-fec0ee78d359 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.828446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558b0e-bce4-416c-9c95-fec0ee78d359 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.828987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42558b0e-bce4-416c-9c95-fec0ee78d359 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.830540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.831129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 455/888] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:22.835577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.837419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48f88f-856f-47cf-a20d-69d78ab339e7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.837935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48f88f-856f-47cf-a20d-69d78ab339e7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.838424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48f88f-856f-47cf-a20d-69d78ab339e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:22.845969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:22.847020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:22.847992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 434/889] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:22.854361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.867379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ae48f88f-856f-47cf-a20d-69d78ab339e7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:22.869362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ae48f88f-856f-47cf-a20d-69d78ab339e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:22.953943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 456/890] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:22.960206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883a18-e3c2-47ab-9871-cc835afbb1fe None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.960812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883a18-e3c2-47ab-9871-cc835afbb1fe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.961249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883a18-e3c2-47ab-9871-cc835afbb1fe None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.964051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 457/891] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:22.968985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.969467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.970148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.978310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f93915-7cf3-4f7c-9c27-e9f54d73344f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.990540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:22.992011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:23.015375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.023034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.023735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.024317 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.024714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.025998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.026553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.029326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.050892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 435/892] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.056783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.075464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 458/893] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:23.165471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f9ed7-07c7-4285-891a-7c27df6c8e35 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.199177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.200036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.200461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.200940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.239929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.272732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.285325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.286832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.306705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.379128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ddbd2-2395-4caf-88fe-2436ab42a017 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.395385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 436/894] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:23.396434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.418975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.419536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.419816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.420093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.423464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.423464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4e11ab9a-ad4d-41b6-af1d-40c9c4694a95 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:23.431278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:23.432309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:23.433186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 459/895] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:23.435503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0c019-1f6c-481e-a9a8-314e50c28102 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.435791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0c019-1f6c-481e-a9a8-314e50c28102 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.436058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0c019-1f6c-481e-a9a8-314e50c28102 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.437539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 460/896] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:23.441190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0c019-1f6c-481e-a9a8-314e50c28102 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.484177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.493792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d79084-b60a-4bb5-930e-a0aa7ea58637 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.525946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.526558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.526854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.527114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.527749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.529163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.541953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0c019-1f6c-481e-a9a8-314e50c28102 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.544325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 437/897] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:23 2022] POST /identity/v3/services => generated 241 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:23.545144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.556155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.588819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.589458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.589732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.589995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.602909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.604383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e8357eff-14dd-41a6-a2eb-08e5d3cae940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:23.622530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:23.623680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:23.624713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:23.624713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:23.624713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:23.624713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 461/898] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:23.625524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.625840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.626110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.648363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:23.649747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:23.658286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e1d74-914c-45da-8c0b-f49a23ee46f3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.695490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.696185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.696903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.697183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.697831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.698135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.700257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.705791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 438/899] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.711513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.728757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 462/900] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:23.729692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.730533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.832684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:23.834016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ff8a-9a11-41cd-91dd-142f0f148f2f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.842512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fcfbf-6138-4c25-aa9e-2ea46b5a894d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:23.870338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.871100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.871379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.871650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.872335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.872664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.874309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.878811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:23.879431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.879705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.879968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.880595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:23.880921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:23.882381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:23.886933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 439/901] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.892025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 463/902] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.897455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.898723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:23.981985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.009527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04df3a6-fb2f-428a-800d-c243e54ad871 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.019370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95499dd9-6747-48f0-81a8-25e7b7446c1c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.043899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.044676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.044957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.045221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.051982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.053449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.055411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.056028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.056297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.056566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.057287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] RBAC: Adding query filter params (interface=public, service_id=4d3da17d1ac545e59641f6e4d3916444, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.057588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.058926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.072765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 464/903] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/endpoints?service_id=4d3da17d1ac545e59641f6e4d3916444&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:24.072952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:24.074015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:24.075129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:24.075690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.075784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 440/904] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:24.075784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.093324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.177868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f944601-b205-4f10-b924-2752ce6c3eaa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.178577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b64c4-1fa0-474f-8555-be7b8b8bfce9 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.213488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.214139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.214419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.214746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.215264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.215883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.216488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.216595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.216803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.217043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.217641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.219521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.220773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:24.225610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:24.226559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:24.227458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 465/905] 10.222.0.65 () {56 vars in 1132 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:24.228933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.229007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 441/906] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:45:24.232449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.343098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.356169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4086a-7c2e-473f-8a75-ef421204cb33 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.368011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98b5ed-5341-4f82-8599-42de0dc61137 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.401813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.402945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.403444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.403952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.404970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.405514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.407504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.410889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.411525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.411804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.412074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.412942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.413630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.415635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 442/907] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:24.417416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.421307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.438756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 466/908] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:24.445611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.503616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.553177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f1597-cb57-4daa-96e8-0b534d8340d9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.578460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f70ba9-d7b3-4ad8-916a-af6c38cb589a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.597768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.598897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.599410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.599836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.600593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.601077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.603380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.610761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 443/909] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:24.616779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.626058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.626682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.626962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.627233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.627972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] RBAC: Adding query filter params (role.id=db2af065cbd9498a8113a2c2a33ff59b, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=7341e345e620445583169f35d05deddc) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.628278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.630331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.640714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 467/910] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/role_assignments?user.id=7341e345e620445583169f35d05deddc&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=db2af065cbd9498a8113a2c2a33ff59b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:24.734290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c2a9-8602-4890-9ab1-37aa2cf078d1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.763027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.777433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.778325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.778747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.779159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.780044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] RBAC: Adding query filter params (interface=public, service_id=dbba7bef75df415d9e3c3896bc534cd4, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:24.780494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.782211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47688b3-74f8-41f6-9ca5-9d98f41be5e2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.789751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 444/911] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/endpoints?service_id=dbba7bef75df415d9e3c3896bc534cd4&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:24.797252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.811538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.907544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61490-5091-4a19-a9cb-484898cee840 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.945915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cb09d-d691-4ec6-83f8-a592efa8d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.947031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cb09d-d691-4ec6-83f8-a592efa8d159 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.947519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cb09d-d691-4ec6-83f8-a592efa8d159 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.948004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cb09d-d691-4ec6-83f8-a592efa8d159 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.948844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cb09d-d691-4ec6-83f8-a592efa8d159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.950502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cb09d-d691-4ec6-83f8-a592efa8d159 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.961296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 468/912] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:25.760575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01dbc-b1e4-4814-bc93-5ffeb3fce268 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:25.761152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01dbc-b1e4-4814-bc93-5ffeb3fce268 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:25.761152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01dbc-b1e4-4814-bc93-5ffeb3fce268 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:25.762697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 445/913] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:25.768185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:25.768592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:25.768804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:25.786776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:25.787940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:25.848949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:25.860774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 469/914] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:26.119799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01dbc-b1e4-4814-bc93-5ffeb3fce268 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:26.224531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01dbc-b1e4-4814-bc93-5ffeb3fce268 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:26.259514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:26.260486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.261008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.261497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.262269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:26.263834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:26.273145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:26.274188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:26.275040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:26.277758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 446/915] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:26.284641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:26.389424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df042693-ac20-4493-9433-0f2ac215a12f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:26.429978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:26.430598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.430871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.431138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.431819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:26.432120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:26.433501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a0ebeb-6445-43e9-bf2f-b1acd9016559 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:26.443042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 470/916] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:26.450073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:26.491265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6224ba-6e69-40b2-b1d8-4cf84127540f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.491616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6224ba-6e69-40b2-b1d8-4cf84127540f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.491883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6224ba-6e69-40b2-b1d8-4cf84127540f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.494368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 471/917] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:26.502137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.502563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.502929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.515313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:26.522830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:26.524394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:26.564988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fcd37-c7a9-4e5c-b70c-de8a721ad59c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:26.590845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:26.602955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 472/918] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:26.611561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:26.612371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.613178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.613588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.614412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:26.614903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:26.616407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:26.621792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 447/919] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:26.629705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:26.730922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e5c5a-cbb7-4314-944a-9f8244b0ae77 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:26.769626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:26.771070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.771542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.772024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.773003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] RBAC: Adding query filter params (interface=public, service_id=d7732e950d984fa78a68c54005d2234f, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:26.773527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:26.775091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:26.781417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 473/920] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/endpoints?service_id=d7732e950d984fa78a68c54005d2234f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:26.793249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:26.903783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da99020-9682-4362-8a14-59f696b97646 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:26.921528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:26.923993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:26.947113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a43d3d-7aa5-4a10-8818-43754a963d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:26.948526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a43d3d-7aa5-4a10-8818-43754a963d64 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.949296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a43d3d-7aa5-4a10-8818-43754a963d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.949742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a43d3d-7aa5-4a10-8818-43754a963d64 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.950767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a43d3d-7aa5-4a10-8818-43754a963d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:26.953005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a43d3d-7aa5-4a10-8818-43754a963d64 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:26.962764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 448/921] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:26.969861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2bd4-2ea2-498f-a8bd-977d10ea6daf None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.970156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2bd4-2ea2-498f-a8bd-977d10ea6daf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.970412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2bd4-2ea2-498f-a8bd-977d10ea6daf None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.972298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 449/922] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:26.978183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.978183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.978486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.995512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.000009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:27.001612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:27.052301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf3b00-2a5c-4bb7-908a-8c3a25be211b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.092972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 450/923] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:27.094300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.095155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.095636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.096085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.096894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.098509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-60a5a30f-2055-48a6-b413-ffe88bc46f0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:27.108791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:27.109957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:45:27.110820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:27.113843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 474/924] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:27.125961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.151687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7dbf8-f2ec-400a-8682-e7cc150c8455 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.152031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7dbf8-f2ec-400a-8682-e7cc150c8455 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.152250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7dbf8-f2ec-400a-8682-e7cc150c8455 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.154807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 475/925] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:27.160843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.161242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.161611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.188335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:27.190093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:27.237159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8970bb-d201-4552-a086-287a5d26fb1d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.251418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.267460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 476/926] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:27.274425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.274992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.275265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.275530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.276155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.276449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.277847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.283021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 451/927] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.293963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.345924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.382683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.398421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad887387-2273-430e-a6b9-81b6e1f4443b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.433083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.433725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.434002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.434268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.434905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.435202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.436561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.448653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 477/928] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.448943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.507591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007094e-b502-455e-8af4-48a99853dc52 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.550113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.550729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.551000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.551264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.559642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548ecd3-9cf9-48da-bf92-5577150b06f3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.562746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:27.567499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:27.568442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:27.569347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 452/929] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:27.574256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.578619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.598471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.599089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.599371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.599644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.600313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.601718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.610774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.633173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 478/930] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:27.634183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.684548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb20435-29a4-47b8-8776-188437598ecb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.735796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.736442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.739640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.739936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.740541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.741959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:27.753137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:27.754229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:27.755149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 453/931] 10.222.0.65 () {56 vars in 1132 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:27.760538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.798753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc466e-5eb4-4acd-955e-9223a5e332f8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.844683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.845693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.845975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.846250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.846932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.847689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.849485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.860288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 479/932] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.866883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.872309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.881171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288fe231-b147-4971-9045-b2435ea8af4d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.909872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.923123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.924038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.924556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.925057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.925888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.926380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.928187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.934293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 454/933] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.940697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.993892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c283f-1e7d-44a2-9a57-61d789969ed4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.033041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.034184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.035124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.035697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.057820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.057820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.058060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a89fa2-ec6d-47f6-9308-2489c8f26e82 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:28.071878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:28.072879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:28.073849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:28.073849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:28.073849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:28.078006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 480/934] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:28.078931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.099210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.100331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.100780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.101145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.101905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:28.102316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.104601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.112315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 455/935] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:28.118326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.149429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.189838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.210163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca9d3-bab1-43e4-952b-94ff41a01dc0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.235757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec6a19-daee-4f76-9cdb-f6ba83108a5a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.250034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.251333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.251814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.252670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.253787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:28.254269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.256193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.282500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.282500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.282500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.282500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.282957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.283775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 481/936] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:28.283894 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.285136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.313924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 456/937] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:45:28.412537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ac024-5e75-421b-b1e4-00f8e7f39e91 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.466610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.467676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.468164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.468718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.477691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.479596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:28.494052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:28.495064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:28.496065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:28.499092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 482/938] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:28.505585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.597300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.619092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157191a-de67-4b60-ab71-31f54c753606 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.656276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.656982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.657256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.657520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.658322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:28.658623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.660044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.678196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 457/939] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:28.683956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.687276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:28.791252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fcd6-d786-49ca-b178-a71fd4f2c6a0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:28.826976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:28.828483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:28.829021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:28.829524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:28.840488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:28.842195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:28.857249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:28.858206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:28.859124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:28.859124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:28.859124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:28.861299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 483/940] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:28.867625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:28.975779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ad987-1e1a-46fa-ba33-b4df6ce845b0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.012107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.013157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.013635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.014098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.014951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:29.015457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.017307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.024550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:29.035503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.039587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 458/941] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:29.093705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:29.148106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7de92-3ae4-44cd-9642-3b8679d5966d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.181062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.181696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.181968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.182234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.189174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.190608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7266771f-e0c0-4d03-922a-bcda02784ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:29.202656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:29.203608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:29.204794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 484/942] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:29.209868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.218151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3b03-a38c-470e-8de7-dfc2e6754ef8 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.218427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3b03-a38c-470e-8de7-dfc2e6754ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.218702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3b03-a38c-470e-8de7-dfc2e6754ef8 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.220096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 485/943] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:29.225079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.225356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.225623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.247666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:29.249698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:29.315496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4627d-edf2-4082-8abb-9cad6299d52a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.340481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 486/944] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:29.353630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.354273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.354555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.354834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.355552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:29.355856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.357712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.373568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 459/945] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:29.379757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.430955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:29.490624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9718f9-c4db-4171-9a59-81ee10b7719d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.524534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.525552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.526021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.526492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/7341e345e620445583169f35d05deddc/roles/db2af065cbd9498a8113a2c2a33ff59b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.528835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=7341e345e620445583169f35d05deddc, role_id=db2af065cbd9498a8113a2c2a33ff59b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.530502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.545980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 487/946] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:29 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/7341e345e620445583169f35d05deddc/roles/db2af065cbd9498a8113a2c2a33ff59b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:29.602413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.679999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:29.728829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309128ba-2ac2-4def-8893-1410718ae99c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.765373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.766148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.766420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.766682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.767264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.768632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:29.777754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:29.778759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:29.779729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 460/947] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:29.785006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.891557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1236b-5b14-4182-be0a-2c3245a40265 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:29.893967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:29.927327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:29.927942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.928218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.928491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.929143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:29.929440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:29.930792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666a9e1-18d4-45e9-b62c-b446987796dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:29.936005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 488/948] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:29.941460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:29.979993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7f05-d57f-4e9a-9197-e849b5d4a47d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.980293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7f05-d57f-4e9a-9197-e849b5d4a47d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.980448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7f05-d57f-4e9a-9197-e849b5d4a47d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.982038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 489/949] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:29.991965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.992257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.992509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.014875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:30.016103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:30.062106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decb4a6-ae9b-4ca9-aa4b-7801a6f6eebe None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.084751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.098122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.098734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.099013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.099282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.099915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:30.100212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.101756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.102009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 490/950] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:30.108834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 461/951] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:30.121694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.222470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.226414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9146778-8c79-4985-9da3-47aa1e40148d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.261126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.262016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.262439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.262848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.263641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.265159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.286728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 491/952] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:30.401561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.510236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e303dd-7dd1-4a0d-9459-55505a7c25dd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.550968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.551498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.551767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.552028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.552695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.554224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.556962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING keystone.server.flask.common [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:45:30.578171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.sql.core [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:45:30.578171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:45:30.578171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [parameters: {'id': 'c16bc7ea3f08435baff171c90c056d43', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:45:30.578171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81564) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-0fa1edde-09d4-4000-aa1f-f1e1e9838417 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c16bc7ea3f08435baff171c90c056d43.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c16bc7ea3f08435baff171c90c056d43. Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:45:30.586814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result.read() Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 19:45:30.587695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application yield resource Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise self.value Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application session.commit() Sep 13 19:45:30.588668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:45:30.589583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:45:30.590481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application result.read() Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:45:30.591272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [parameters: {'id': 'c16bc7ea3f08435baff171c90c056d43', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:30.592143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:30.594516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c16bc7ea3f08435baff171c90c056d43. Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:30.596773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 462/953] 10.222.0.65 () {60 vars in 1140 bytes} [Tue Sep 13 19:45:30 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:30.598172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.702298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6699e2-82e6-43c8-90e2-2ba124a72e3c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.719520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a8f5-3011-4e0b-88ca-a7f5fb11c425 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.719844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a8f5-3011-4e0b-88ca-a7f5fb11c425 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.720054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a8f5-3011-4e0b-88ca-a7f5fb11c425 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.724550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 463/954] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:30.729574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.729867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.730137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.737894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.739401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.739684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.739962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.747994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.749289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:30.749499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.750948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:30.763746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:30.765635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:30.766938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:30.770789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 492/955] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:30.771915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.791761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.793003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.833384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 464/956] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:30.888930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa265ba-154c-4016-aa2f-081350049dfc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.923735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.924458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.924602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.924891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.925555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:30.925857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.927292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.951668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 493/957] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:31.097110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:31.202750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52656373-e2d7-4339-97e4-1fd31fbfaaae None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:31.240443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:31.241110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.241433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.241702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.242284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:31.243782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:31.253088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:31.255370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:31.257351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 465/958] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:31.260573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:31.340410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:31.367029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58543ec-3155-41c8-a5e5-90a64443cbc0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:31.404598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:31.405248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.405530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.405793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.406432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:31.406733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:31.408116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ee7f-d50e-42c9-a0d0-77303a2a94f7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:31.413578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 494/959] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:31.419260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:31.462746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:31.534775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54a58c-adce-45bb-99de-fbbff878832e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:31.569201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:31.569814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.570089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.570361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.570989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:31.571285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:31.572665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266cbf-5267-4037-852c-b26a034c4215 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:31.577668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 466/960] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:31.873270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c4dc-4be8-460d-8a2e-90e815c38f46 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.875444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c4dc-4be8-460d-8a2e-90e815c38f46 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.875444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c4dc-4be8-460d-8a2e-90e815c38f46 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.875444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 495/961] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:31.884206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:31.884206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:31.884206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:31.900348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:31.901895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:31.968914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 467/962] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:32.239176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c4dc-4be8-460d-8a2e-90e815c38f46 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.340870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c4dc-4be8-460d-8a2e-90e815c38f46 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.387426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfc23-9f25-47cb-97c1-6890af2be8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.388084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfc23-9f25-47cb-97c1-6890af2be8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.388361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfc23-9f25-47cb-97c1-6890af2be8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.388656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfc23-9f25-47cb-97c1-6890af2be8e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.396778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.400466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dfc23-9f25-47cb-97c1-6890af2be8e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4f2dfc23-9f25-47cb-97c1-6890af2be8e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:32.405757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:32.406978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:32.408003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:32.410575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 496/963] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:32.416498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.446847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.480221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034d4dd-a50d-483d-9e3a-c7b54c5dc7c0 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.481106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034d4dd-a50d-483d-9e3a-c7b54c5dc7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.481629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034d4dd-a50d-483d-9e3a-c7b54c5dc7c0 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.483525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 497/964] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:32.488820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.489435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.489899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.516086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:32.517676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:32.527479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef6c71-1405-4344-86e7-838ac66b7bd8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.561224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.561829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.562286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.562758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.563567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:32.563999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.565852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.574504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 468/965] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:32.580684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.592746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 498/966] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:32.668416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.680177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25138af9-7694-48ec-b920-e9d71ccea4ba None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.716111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.716772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.717050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.717319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.728156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.729690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:32.744606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:32.745601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:32.746489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:32.746489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:32.746489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:32.746489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 469/967] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:32.751650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.869790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dd488-3440-4930-b418-8302c7e29b06 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:32.875453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.902673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:32.912484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:32.913203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:32.913477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:32.913753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:32.915224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:32.915526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:32.916917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:32.932078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 499/968] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:32.937620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:32.984225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9499e5-b496-4586-822b-d1043dcb44e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.022459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.023442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.023917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.024372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.025261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.026915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:33.036549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:33.037874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:33.038716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:33.041056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 470/969] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:33.047006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.052774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.062884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ddf73-7752-4cdf-9471-8db688ddb112 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.100493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.101259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.101541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.101862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.111674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.113620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:33.126410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:33.127381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:33.128330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:33.130960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 500/970] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:33.136369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.179500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656c3d-dfa6-4068-9e2e-fab0686cc696 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.186605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.218940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.220100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.220676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.221142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.221958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.222466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.224165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.230052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 471/971] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:33.235429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.238801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebb745-1f66-4397-9e13-87df676010f1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.276233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.277619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.278075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.278515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.279432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.279891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.281668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.304899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 501/972] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:33.307252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.312869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.350535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462202f-e432-4aa8-a96c-ed7d16af64fa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.387965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.388585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.388889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.389153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.389775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.390070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.391548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e308055-9e55-4071-a07a-73de362c920e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.400687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 472/973] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:33.400687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1748f4-118a-4717-98b3-285ff7b70af1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.400687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1748f4-118a-4717-98b3-285ff7b70af1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.400687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1748f4-118a-4717-98b3-285ff7b70af1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.400687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 473/974] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:33.402220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1748f4-118a-4717-98b3-285ff7b70af1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.418832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf028605-17e2-4816-ae9a-45b60e13c12f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.429332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.458501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.459434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.459865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.460287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.507970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1748f4-118a-4717-98b3-285ff7b70af1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.533748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.535108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.538838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.543618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.544028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.544300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.544560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.545283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] RBAC: Adding query filter params (interface=admin, service_id=d7732e950d984fa78a68c54005d2234f, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:33.545758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.546915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9499-0905-450c-bae8-24035614368d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.556748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 474/975] 10.222.0.65 () {56 vars in 1249 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/endpoints?service_id=d7732e950d984fa78a68c54005d2234f&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:33.557902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.558179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.558454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.575505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:33.576684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:33.639205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 502/976] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:33.640121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.648843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.660810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 475/977] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:33.661843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.766647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5805f-7821-445e-a462-fea2c1072a10 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.792107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac54ba-59e6-4160-9875-ae8641ea91e9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.804593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a147a-14e0-4cf5-a0ad-8d30fcb6a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.805529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a147a-14e0-4cf5-a0ad-8d30fcb6a10b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.805811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a147a-14e0-4cf5-a0ad-8d30fcb6a10b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.806538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a147a-14e0-4cf5-a0ad-8d30fcb6a10b None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.807155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a147a-14e0-4cf5-a0ad-8d30fcb6a10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.809037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a147a-14e0-4cf5-a0ad-8d30fcb6a10b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.821067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 503/978] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:33.821376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.821483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7206-5c52-4bc3-98fa-db672319bb76 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.821483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7206-5c52-4bc3-98fa-db672319bb76 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.821483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7206-5c52-4bc3-98fa-db672319bb76 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.824647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 504/979] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:33.828698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.829364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.829642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.829974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.834975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.835267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.836102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.845028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.846569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.859867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:33.861168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:33.866826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:33.867835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:33.869303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:33.869303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:33.869303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:33.871198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 476/980] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:33.876576 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.948934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.960055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 505/981] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:33.962475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.995645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc341c4-c5c5-4a74-bbf2-bc64d2173937 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.039521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.040194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.040410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.040728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.041885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:34.041885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.043090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.056854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 477/982] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:34.062686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.090453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dd033-c04b-4969-b8e8-00ff7b231aa2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.119383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.132696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.133314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.133592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.133999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.134662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.136385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.139430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING keystone.server.flask.common [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:45:34.156509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.sql.core [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:45:34.156509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:45:34.156509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [parameters: {'user_id': 'e156e080f97b49b583f28b0e7567bd95', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:45:34.156509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81563) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Sep 13 19:45:34.175317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:45:34.176360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application yield resource Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise self.value Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application session.commit() Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:45:34.182521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:45:34.183418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:45:34.184320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application result.read() Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:45:34.187212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e156e080f97b49b583f28b0e7567bd95', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:34.189310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 19:45:34.191850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 506/983] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/users => generated 160 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:34.194210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.199456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627b0dd6-87b7-4e47-804a-4cfb99079957 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.238242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.238928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.239207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.239523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.246770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.248209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:34.260322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:34.261240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:34.262154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 478/984] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:34.262648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.269659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.310803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b000535-2769-439c-bb91-cfe97d691fb0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.349542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.350192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.350473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.350776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.359030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.360763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.370188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:34.373205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:34.374159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:45:34.375682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:34.376266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fd03-f8f2-40c2-8fcb-b4452c536943 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.376343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 507/985] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:34.376343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.415075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.415685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.415958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.416221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.416889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.418251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.438711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 479/986] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:34 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:34.438900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.510095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92871846-dc2d-4f39-98b7-715bf7e86952 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.540509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.569089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.569771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.570051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.570321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.571050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:34.571353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.573363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.586323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a1134-af8f-4b34-ab1f-6ca3f0f0c9dd None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.592544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 508/987] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:34.594894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.641166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.641829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.642105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.643129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.643129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:34.643402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.645637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f419dcc-4ea3-406f-915c-53563667a020 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.681602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 480/988] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:34.722076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d649a5-1c71-41f3-8f95-88fbea29386d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.764301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.764972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.765348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.765758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.766540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] RBAC: Adding query filter params (role.id=db2af065cbd9498a8113a2c2a33ff59b, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=7341e345e620445583169f35d05deddc) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:34.766847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.768323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f791ef-20af-4372-ad2c-c87545246bbd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.775760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 509/989] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/role_assignments?user.id=7341e345e620445583169f35d05deddc&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=db2af065cbd9498a8113a2c2a33ff59b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:36.016079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c2da0-a2e3-419a-87f6-d82deeba619b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.016852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c2da0-a2e3-419a-87f6-d82deeba619b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.016852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c2da0-a2e3-419a-87f6-d82deeba619b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.018179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 481/990] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:36.023387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.023842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.023923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.042617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:36.044142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:36.079008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.111664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 510/991] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:36.382476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c2da0-a2e3-419a-87f6-d82deeba619b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.401336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.501002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c2da0-a2e3-419a-87f6-d82deeba619b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.543532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.544206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.544508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.544804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.545414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.546843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-5d164e66-735a-461d-ad63-39e96eb2ebbb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:36.557134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:36.558210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:36.564848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 482/992] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:36.565690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.659967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f746d-4271-4ded-8b7c-1a3790e03cd1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.660208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f746d-4271-4ded-8b7c-1a3790e03cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.660472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f746d-4271-4ded-8b7c-1a3790e03cd1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.661963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 483/993] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:36.666647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.666930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.667197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.668782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126837d2-405f-4890-be6c-e1f3a9482f50 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.685414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:36.686755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:36.704345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.705061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.705286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.705555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.706181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:36.706480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.707832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.713093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 511/994] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:36.718670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.754958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.764683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 484/995] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:36.821147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62b90-1e66-49c1-ab75-0ee697246671 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.861213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.861961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.862154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.862439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.864173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:36.864173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.865589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4418cf8-5726-47db-8062-3822bed595a6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.872202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 512/996] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:36.878407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.893575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.980584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7d37f-75f8-4f38-a562-7ea4ebea2603 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.980873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7d37f-75f8-4f38-a562-7ea4ebea2603 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.981134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7d37f-75f8-4f38-a562-7ea4ebea2603 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.982466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 513/997] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:36.988295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bbd92-0673-4846-927d-c0780be10593 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.988544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bbd92-0673-4846-927d-c0780be10593 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.988872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bbd92-0673-4846-927d-c0780be10593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.012677 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-749bbd92-0673-4846-927d-c0780be10593 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:37.014301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-749bbd92-0673-4846-927d-c0780be10593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:37.017794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6e0de-7d6f-4fc3-8053-6a62b367edb4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.058390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.059008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.059303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.059558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.060222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.061686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.092648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 485/998] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:37.093418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.109561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 514/999] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:37.183214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.219092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeec176-0b7d-468a-aa12-f9d090d99b2f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.254381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.255025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.255299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.255566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.256154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.257568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:37.267142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:37.268216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:37.273545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 486/1000] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:37.275562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bbd92-0673-4846-927d-c0780be10593 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.306021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.378194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.395302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bbd92-0673-4846-927d-c0780be10593 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.437694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.438574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.439023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.439438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.440211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.440862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.442897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.448172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 515/1001] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:37.453827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.494818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca9272-3eb5-4b20-a63d-d170e14202a6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.537405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.538304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.538730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.539015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.539597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.540990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.543400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:37.552449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:37.553744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:37.554695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:37.557111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 487/1002] 10.222.0.65 () {56 vars in 1105 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:37.561315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.565912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.581130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b936b-cbe2-4fe3-8903-06a58e63830d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.636408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.637263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.637515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.637855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.638894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.639301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.641571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.653767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 516/1003] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:37.655073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.708113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231aab7-e99a-4b9e-b086-88afcc660ae6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.743858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.744577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.744879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.745161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.745767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.746063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.747431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.752544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 488/1004] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:37.758149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.767011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7aa949-190f-4ab9-8066-cd360432e5dc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.803615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.804140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.804417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.804716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.805511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] RBAC: Adding query filter params (interface=public, service_id=cb32d165af534dd28b25d939e49abe46, region_id=RegionOne) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.805818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.807287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.817365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 517/1005] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/endpoints?service_id=cb32d165af534dd28b25d939e49abe46&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:37.818380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:37.826161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.839865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.868880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813fd3-88ee-42b7-abaf-d9e32c68c7c2 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.904870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.905482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.905756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.906023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.906643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] RBAC: Adding query filter params (type=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:37.906951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.908315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ee75a-67bc-4b90-aa4f-ded90f7b41bd None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.925052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 489/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:37.935981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a165a-c6fe-4da9-91f9-824f1b37e580 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.974393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eec70-c440-4f58-aff7-2e5debced70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.975032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eec70-c440-4f58-aff7-2e5debced70b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.975308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eec70-c440-4f58-aff7-2e5debced70b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.975581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eec70-c440-4f58-aff7-2e5debced70b None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.976203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eec70-c440-4f58-aff7-2e5debced70b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.977650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eec70-c440-4f58-aff7-2e5debced70b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.985313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 518/1007] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:37 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:39.350671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c97f1-b0eb-479e-9f03-c5bd1e05f1d8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.351248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c97f1-b0eb-479e-9f03-c5bd1e05f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.351248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c97f1-b0eb-479e-9f03-c5bd1e05f1d8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.352724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 490/1008] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:39.357997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.358418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.358523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.377645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:39.378806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:39.451933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 519/1009] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:39.712354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c97f1-b0eb-479e-9f03-c5bd1e05f1d8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:39.820581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c97f1-b0eb-479e-9f03-c5bd1e05f1d8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:39.846914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:39.857669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c422b6-f7d3-48bd-aa9e-0feb2ee567d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:39.858299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c422b6-f7d3-48bd-aa9e-0feb2ee567d8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.858589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c422b6-f7d3-48bd-aa9e-0feb2ee567d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.858857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c422b6-f7d3-48bd-aa9e-0feb2ee567d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.860081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c422b6-f7d3-48bd-aa9e-0feb2ee567d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:39.861601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c422b6-f7d3-48bd-aa9e-0feb2ee567d8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:39.863749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 491/1010] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:39.869405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:39.884079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:39.973976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c622d-547a-4256-9848-88aa3843f9f2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:40.014256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd72aa-9904-4ad1-ba14-4905a1bfff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:40.014852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd72aa-9904-4ad1-ba14-4905a1bfff3d None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.015158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd72aa-9904-4ad1-ba14-4905a1bfff3d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.015393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd72aa-9904-4ad1-ba14-4905a1bfff3d None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.016159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd72aa-9904-4ad1-ba14-4905a1bfff3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:40.017608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd72aa-9904-4ad1-ba14-4905a1bfff3d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:40.047740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 520/1011] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:39 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:40.094824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b70e-df34-4bc7-8891-d7fb3963bc20 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.095079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b70e-df34-4bc7-8891-d7fb3963bc20 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.095326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3b70e-df34-4bc7-8891-d7fb3963bc20 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.096898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 492/1012] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:40.102514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.102839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.103024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.123773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:40.125038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:40.169820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c89d6-562a-4116-89b9-209864103066 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.170162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c89d6-562a-4116-89b9-209864103066 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.170364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c89d6-562a-4116-89b9-209864103066 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.171864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 493/1013] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:40.177578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.177855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.178188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.195107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:40.197339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:40.198585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:40.207889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 521/1014] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:40.274457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 494/1015] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:40.477260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:40.537209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:40.587254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156cefb-9120-4be8-9896-20514223dd43 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:40.624389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:40.625406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.625841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.626125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.626789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:40.628136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:40.646661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d910a-8840-426e-be4c-9d84e1e1a755 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:40.648784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 522/1016] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:40 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:40.678651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:40.697846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:40.698488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.698764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.699031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.699610 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:40.701042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:40.710622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:40.711824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:40.712758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:40.714308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 495/1017] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:40.718198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:40.777038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:40.830761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9207f-b1ea-4bf6-a87d-b6e53bb90776 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:40.870282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:40.870282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:40.870591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:40.870843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:40.871356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:40.872045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:40.873025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:40.878349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 523/1018] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:40.884493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:40.991232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10104c68-8497-4058-8dc7-2c4b22f16df0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.028605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.029245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.029570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.029928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.030632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:41.030919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:41.032462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2728e6b-2625-419b-b1b1-dd036da77a51 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:41.038061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 496/1019] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:41.043689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:41.146653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c30143-2ce7-44a2-af52-db6eac8ea088 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:41.163167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:41.181293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9e222-b422-46d7-bd80-dd6ac1ce5680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:41.181903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e222-b422-46d7-bd80-dd6ac1ce5680 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:41.182178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e222-b422-46d7-bd80-dd6ac1ce5680 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:41.182446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9e222-b422-46d7-bd80-dd6ac1ce5680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:41.183114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9e222-b422-46d7-bd80-dd6ac1ce5680 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:41.184469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9e222-b422-46d7-bd80-dd6ac1ce5680 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:41.205665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 524/1020] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:42.283331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf291-4291-4b1c-8b1b-c4fbccac5e14 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.283941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf291-4291-4b1c-8b1b-c4fbccac5e14 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.283941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cf291-4291-4b1c-8b1b-c4fbccac5e14 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.285579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 497/1021] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:42.290718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.291166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.291246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.309826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:42.311023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:42.386533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 525/1022] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:42.654121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf291-4291-4b1c-8b1b-c4fbccac5e14 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.707760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.765568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cf291-4291-4b1c-8b1b-c4fbccac5e14 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.799504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7bd95-7cd6-48f2-b8a6-d6f92b37f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.800140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bd95-7cd6-48f2-b8a6-d6f92b37f441 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.800414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bd95-7cd6-48f2-b8a6-d6f92b37f441 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.800711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7bd95-7cd6-48f2-b8a6-d6f92b37f441 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.801831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bd95-7cd6-48f2-b8a6-d6f92b37f441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.803263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7bd95-7cd6-48f2-b8a6-d6f92b37f441 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.805014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 498/1023] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:42.810773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.846502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db6ea-524d-42b4-a797-2d7aee48eb88 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.846786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db6ea-524d-42b4-a797-2d7aee48eb88 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.847065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db6ea-524d-42b4-a797-2d7aee48eb88 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.848478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 499/1024] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:42.853657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.853939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.854217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.874737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:42.875998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:42.915180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.919353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4410f-9f56-4a28-8c2a-a9ee5dd781ee None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.956655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 500/1025] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:42.961409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.962240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.962683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.963109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.963927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.965577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.991986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 526/1026] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:42 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:43.217860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.265611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.321226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275bef9-ab18-4293-9b8d-2ec343e28c4c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.359758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.360415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.360719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.360985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] PATH_INFO: `/v3/services/image` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.361579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.363435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b2222c1c-888f-4f2b-93b8-82beb5735010 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:43.373405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:43.374502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:43.375356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 501/1027] 10.222.0.65 () {56 vars in 1105 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:43.382409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.467643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c3c6-7347-4f94-83a9-f5709b81eddc None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.468001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c3c6-7347-4f94-83a9-f5709b81eddc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.468268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c3c6-7347-4f94-83a9-f5709b81eddc None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.469813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 502/1028] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:43.474623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.475252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.475252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.494730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:43.495933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:43.502458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50d79-4b60-4283-be42-f4e51ff14490 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.539427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.540049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.540325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.540599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.541254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:43.541552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.542908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.548335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 527/1029] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:43.554016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.570971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 503/1030] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:43.576261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.655668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598324b6-d6bb-4f69-80e2-17377a799cc0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.689442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.690053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.690332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.690600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.691230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] RBAC: Adding query filter params (type=image) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:43.691529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.692945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.702682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 528/1031] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:43.704340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.747559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.813147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd4f84-bf37-449d-9dd2-a545659079c4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.837587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.854727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.855371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.855620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.855857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.856576 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] RBAC: Adding query filter params (interface=public, service_id=0d6bc77c6aa148fc8e8035d429e07a3e, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:43.856985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.858248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.865007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 504/1032] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/endpoints?service_id=0d6bc77c6aa148fc8e8035d429e07a3e&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:43.870995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.932558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.951174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6a934-40da-404c-9be8-7ab66fd011da None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.977648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4329f-ad60-4407-a390-196d33cb22a7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.979907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.988848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.989493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.989769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.990029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.001157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:44.006013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:44.006943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:44.007783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 529/1033] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:44.013020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:44.020190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:44.020838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:44.021118 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:44.021384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.022387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:44.023772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:44.031964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 505/1034] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:44.127431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5623cfe-229d-4c94-b221-8f71caea6e75 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:44.164887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:44.165880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:44.166343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:44.166803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.167665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:44.168147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:44.169753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:44.181448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 530/1035] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:44.187572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:44.297771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05386f19-c615-4f8c-bfd9-dadfdc1f64aa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:44.330994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:44.331672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:44.331939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:44.332206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.342332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:44.343763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:44.359264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:44.360251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:44.366839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:44.366839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:44.366839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:44.366839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 506/1036] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:44.367712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:44.377224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:44.478226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73c524-4a95-4fee-a929-94a2813ebdeb None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:44.512823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:44.513434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:44.513714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:44.513980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.514616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:44.514910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:44.516658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:44.530860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 531/1037] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:44.536491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:44.558829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:44.642902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97fe71-b7e1-414c-8c58-7ca273489577 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:44.677160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:44.677797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:44.678077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:44.678344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.686082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:44.687527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:44.698699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:44.699691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:44.700724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:44.701907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 507/1038] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:44.705754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:44.776514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:44.813805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76658156-3db8-487f-9b72-aeae81464af3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:44.855551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:44.856184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:44.856453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:44.856754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:44.857488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:44.857792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:44.859215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4103b8-6bab-496c-9fd3-f4021fc58142 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:44.881404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 532/1039] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:44.882910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:44.970238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:44.991679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7ee2-8055-4c37-955e-91ff6186efe6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.026148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.026762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.027042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.027311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.104144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.105583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.190116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.198998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bae44-cf85-4858-a265-d18e5ee86c5b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.199341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bae44-cf85-4858-a265-d18e5ee86c5b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.199521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bae44-cf85-4858-a265-d18e5ee86c5b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.201122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 533/1040] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:45.206364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.206651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.206922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.221367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 508/1041] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:45.226548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:45.227297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.228118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:45.296560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 534/1042] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:45.334146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f23b2-d96c-4744-b850-aa34320660e0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.368241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.368828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.369108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.369378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.379399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.380866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:45.395601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:45.396552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:45.397794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:45.397794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:45.397794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:45.400967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 509/1043] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:45.402475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.469959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.525299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc3c7-2fb0-45e5-b69d-807d8d446308 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.562759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.563366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.563644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.563907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.564544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:45.564870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.566227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.566856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.580596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 535/1044] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:45.586932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.606045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.683047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4acfd6-bad9-44c9-94c2-ee751dd3c1e0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.696991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392be849-0428-4250-82e9-9ef08eff85a6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.710576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.722632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.723420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.723643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.723919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.730979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.731607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.731910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.732175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.735564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:45.739501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.740970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:45.741333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:45.742243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:45.743180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:45.745470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 510/1045] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:45.751346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:45.753110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:45.754004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:45.754930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 536/1046] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:45.760315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.849220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.859766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff046ae-b037-4efb-a367-4d499cdb5111 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.865682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d0a29-f3e6-45dc-871f-8274e7e4de3d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:45.895519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.896243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.896511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.896804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.897457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:45.897752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.899120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.901049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:45.902176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.902451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.902722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.903407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:45.903711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:45.905607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:45.912791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 511/1047] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:45.914255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.918434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 537/1048] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:45.923799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:45.959229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.019089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40c5f-eb55-4567-b417-8c76d28d7130 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.031373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476dcf9-2803-4261-becc-b748e7825f7a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.053370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.053989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.054275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.054526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] PATH_INFO: `/v3/users/bcc2f91982194375b80b7ac236d32ba5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.067517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.068220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.068507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.068735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] RBAC: Authorizing `identity:get_user(user_id=bcc2f91982194375b80b7ac236d32ba5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.068840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.069552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] RBAC: Adding query filter params (role.id=db2af065cbd9498a8113a2c2a33ff59b, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=3a919420853a4ac8b461e303fc993429) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:46.069858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.070205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.071316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd646062-5b57-4f3d-acc8-e22ddfc207b5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.077019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 512/1049] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/users/bcc2f91982194375b80b7ac236d32ba5 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:46.078286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.078445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 538/1050] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:45 2022] GET /identity/v3/role_assignments?user.id=3a919420853a4ac8b461e303fc993429&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=db2af065cbd9498a8113a2c2a33ff59b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:46.096912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.193920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9cc7d-9c5e-4c56-bad1-7bec7c890832 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.198686 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1918e-467c-449a-a033-d15170cab9af None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.199011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1918e-467c-449a-a033-d15170cab9af None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.199238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1918e-467c-449a-a033-d15170cab9af None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.200843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 539/1051] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:46.206614 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.206897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.207155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.227115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:46.228245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:46.238526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b771a-9775-4645-9505-659ba870fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.240021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b771a-9775-4645-9505-659ba870fcba None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.240521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b771a-9775-4645-9505-659ba870fcba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.241454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b771a-9775-4645-9505-659ba870fcba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.310148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 540/1052] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:46.319570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b771a-9775-4645-9505-659ba870fcba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.321058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b771a-9775-4645-9505-659ba870fcba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.336516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.423613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 513/1053] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:46.428370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.457147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.530395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac17aa4-37d9-458c-987e-7ae87cc19206 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.566617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.567254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.567530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.567792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.568938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] RBAC: Authorizing `identity:get_project(project_id=18b2a1dd3a7d4e708d037bcab4589eb7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.570354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.577165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 541/1054] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:46.578166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b771a-9775-4645-9505-659ba870fcba None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.578532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.684484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.684873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b771a-9775-4645-9505-659ba870fcba None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.692151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cd522-5f6e-44c8-bea8-21c3ed3484a7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.698565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.720509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.721168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.721439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.721703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] PATH_INFO: `/v3/services/image` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.722274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.723630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.728978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.729593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.729871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.730143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.730869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7, user.id=bcc2f91982194375b80b7ac236d32ba5) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:46.731174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:46.732363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:46.733340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:46.734314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:46.735278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.735349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 514/1055] 10.222.0.65 () {56 vars in 1105 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:46.739725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.753595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 542/1056] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/role_assignments?user.id=bcc2f91982194375b80b7ac236d32ba5&scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:46.855343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2313b9-a919-4b69-9586-675b70174985 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.893037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.893660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.893931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.894196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.894832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:46.895128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.896515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.902252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 515/1057] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:46.908246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:47.021496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0ec5b-400e-41c1-b027-d8b2b4fb99cf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:47.054948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:47.055820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:47.056297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:47.056785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:47.057580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] RBAC: Adding query filter params (type=image) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:47.058048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:47.059566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04c18d-ad99-4bbc-9100-cd3f485c3614 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:47.064834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 543/1058] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:47.070601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:47.113583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:47.174945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42dbeb-4623-4c44-ae1e-39a29704b1f1 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:47.208899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e5aa-78b1-4327-8adf-7bacb72ba753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:47.209509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e5aa-78b1-4327-8adf-7bacb72ba753 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:47.209777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e5aa-78b1-4327-8adf-7bacb72ba753 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:47.210026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e5aa-78b1-4327-8adf-7bacb72ba753 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:47.210682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e5aa-78b1-4327-8adf-7bacb72ba753 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:47.212043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e5aa-78b1-4327-8adf-7bacb72ba753 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:47.236656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 516/1059] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:48.206813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145195-d479-4ad0-a682-eef354e82c85 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.207366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145195-d479-4ad0-a682-eef354e82c85 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.207366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47145195-d479-4ad0-a682-eef354e82c85 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.208897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 544/1060] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:48.213933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.214339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.214435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.233089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:48.234264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:48.314196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 517/1061] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:48.577632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145195-d479-4ad0-a682-eef354e82c85 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:48.605263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:48.685159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47145195-d479-4ad0-a682-eef354e82c85 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:48.718261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12167ce-6d98-4c4c-8828-4ab7f66c0e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:48.718883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12167ce-6d98-4c4c-8828-4ab7f66c0e7e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.719223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12167ce-6d98-4c4c-8828-4ab7f66c0e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.719493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12167ce-6d98-4c4c-8828-4ab7f66c0e7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.729640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12167ce-6d98-4c4c-8828-4ab7f66c0e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b12167ce-6d98-4c4c-8828-4ab7f66c0e7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:48.734447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:48.735374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:48.737569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 545/1062] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:48.742285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:48.767150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:48.852625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1429d78-5bdb-44f1-8bd4-d762cd638b25 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:48.889823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:48.890084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.890165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.890385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.891163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:48.891465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:48.892904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:48.899589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da552-805d-46ff-a254-8de7c0ed21be None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.899876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da552-805d-46ff-a254-8de7c0ed21be None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.900147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9da552-805d-46ff-a254-8de7c0ed21be None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.902115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 546/1063] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:48.904316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 518/1064] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:48.907586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.907878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.908107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.909907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:48.927459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:48.928988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:48.999137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.005251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 547/1065] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:49.018192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd096a-96e4-49b5-be8d-092b6ef4cca6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.051854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.052489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.052793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.053061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.063722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.065207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:49.079101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:49.080041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:49.085795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:49.085795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:49.085795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:49.085795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 519/1066] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:49.087489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.104808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.195485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca704c-68c3-427d-ba6a-66bfcf513236 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.230584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.231198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.231435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.231719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.232361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:49.232660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.234061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.251081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 548/1067] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:49.252478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.271002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.349049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.366177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0779b-d310-40be-971b-ee716e31af4c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.376380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a0d3-d0e4-4d73-a8ec-01f1a2d5a2ae None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.400156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.400820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.401097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.401363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.404010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.409736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.409987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77044e6a-c070-447d-9e79-c783e5b098c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.410615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77044e6a-c070-447d-9e79-c783e5b098c2 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.410886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77044e6a-c070-447d-9e79-c783e5b098c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.411149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77044e6a-c070-447d-9e79-c783e5b098c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.411249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b0dd1cdd-3177-4763-9f9e-c9ec318ecc73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:49.422077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:49.423060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:49.423996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:49.424948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77044e6a-c070-447d-9e79-c783e5b098c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-77044e6a-c070-447d-9e79-c783e5b098c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:49.427039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:49.428354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:49.429485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:49.430284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 520/1068] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:49.430284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a01b69-957a-45b5-a4c0-e5fdd6f0ecba None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.430284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a01b69-957a-45b5-a4c0-e5fdd6f0ecba None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.430284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a01b69-957a-45b5-a4c0-e5fdd6f0ecba None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.431004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 521/1069] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:49.431678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a01b69-957a-45b5-a4c0-e5fdd6f0ecba None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.433587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 549/1070] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:49.436350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.436653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.436905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.454655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:49.455833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:49.528653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 550/1071] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:49.528653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.539531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a01b69-957a-45b5-a4c0-e5fdd6f0ecba None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.574676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.575444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.575719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.575985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.576733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:49.577037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.578499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.583204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.596927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 522/1072] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:49.602662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.626185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39249dc-3021-41ec-893d-ad3c468a0b0e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.662713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.665955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.666810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.667315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.667806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.668715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:49.669208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.671459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.681106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 551/1073] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:49.686832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.731258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21f756-9b0f-4ae5-8cea-2b8f5bdaf635 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.783841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.784493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.785062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.785335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.800203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.801696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:49.816285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:49.817351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:49.818249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:49.818249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:49.818249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:49.818249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 523/1074] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:49.818499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a36e3-f153-45d2-b9b0-f8cc40d3a8e4 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.818584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.846746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.856112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.858088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.858377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.858650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] PATH_INFO: `/v3/users/bcc2f91982194375b80b7ac236d32ba5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.859894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=bcc2f91982194375b80b7ac236d32ba5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.861362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.866409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 552/1075] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/users/bcc2f91982194375b80b7ac236d32ba5 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:49.867011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.933596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb933a2-a57b-4455-8424-9b274ec06323 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.940906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.967718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.968410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.968589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.968880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.978553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8990eff-ab58-4c98-9170-5cff87696fc0 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.011999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.012727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.013008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.013279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.013912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:50.014214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.015567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.027209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 553/1076] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:50.027988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.039156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.040602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.081616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.125868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fc22d-a62d-405b-bd1f-53a7cff8d659 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.136820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 524/1077] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:50.137722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.146540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.159170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.159801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.160076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.160341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.161497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] RBAC: Authorizing `identity:get_project(project_id=18b2a1dd3a7d4e708d037bcab4589eb7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.162952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.164540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 554/1078] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:50.165298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.239021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed419c-da00-4106-a173-473d9037def6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.262725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f211c-950b-4f3f-bfd4-3ae4024980c6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.273154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.273789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.274066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.274331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.281669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.283117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.284719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:50.294521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:50.295422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:50.296326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:50.297278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.297849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.298126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.298393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.300547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 525/1079] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:50.301248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.309083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.310528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:50.325008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:50.326005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:50.326925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:50.326925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:50.326925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:45:50.326925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 555/1080] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:50.326925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.366812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.401219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba66f-7d62-47f1-9805-659e87449acf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.431308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc04e4-8b86-44bf-9e5c-a1d7c4397707 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.435350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.436016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.436293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.436561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7/users/bcc2f91982194375b80b7ac236d32ba5/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.441287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] RBAC: Authorizing `identity:create_grant(project_id=18b2a1dd3a7d4e708d037bcab4589eb7, user_id=bcc2f91982194375b80b7ac236d32ba5, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.443058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.457201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 526/1081] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:50 2022] PUT /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7/users/bcc2f91982194375b80b7ac236d32ba5/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:50.457990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.468095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.468792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.469154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.469416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.470123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:50.470426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.471887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.491348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 556/1082] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:50.492577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.532445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.581785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c4f7-ec99-4d74-91e8-99dafd4073ff None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.607613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c723f5-f570-418d-a461-c1c86ce51290 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.610698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.622844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.623466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.623740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.624003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.624680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:50.624979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.626419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5bd35-5cf9-4ca3-8606-11d0660e07bb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.643410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 527/1083] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:50.652418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dceb4-4099-4a49-b960-b8867fea7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.653195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dceb4-4099-4a49-b960-b8867fea7267 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.653473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dceb4-4099-4a49-b960-b8867fea7267 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.653746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dceb4-4099-4a49-b960-b8867fea7267 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/3a919420853a4ac8b461e303fc993429/roles/db2af065cbd9498a8113a2c2a33ff59b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.655970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dceb4-4099-4a49-b960-b8867fea7267 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=3a919420853a4ac8b461e303fc993429, role_id=db2af065cbd9498a8113a2c2a33ff59b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.657531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dceb4-4099-4a49-b960-b8867fea7267 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.674294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 557/1084] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:50 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/3a919420853a4ac8b461e303fc993429/roles/db2af065cbd9498a8113a2c2a33ff59b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:52.642580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2a145-fab1-4612-926b-ddf87f0fc11a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.643201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2a145-fab1-4612-926b-ddf87f0fc11a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.643201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2a145-fab1-4612-926b-ddf87f0fc11a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.644429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 528/1085] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:52.649932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57175-0d8e-49b3-9c25-9c1601d4ab07 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.650376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57175-0d8e-49b3-9c25-9c1601d4ab07 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.650478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b57175-0d8e-49b3-9c25-9c1601d4ab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.670491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b9b57175-0d8e-49b3-9c25-9c1601d4ab07 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:52.671673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b9b57175-0d8e-49b3-9c25-9c1601d4ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:52.746577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 558/1086] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:52.827453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c449197-a13e-4bd3-8107-26ac3745bb49 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.827694 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c449197-a13e-4bd3-8107-26ac3745bb49 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.827981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c449197-a13e-4bd3-8107-26ac3745bb49 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.829338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 529/1087] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:52.834717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.835005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.835279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.855000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:52.856210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:52.874216 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:52.924949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 559/1088] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:53.010353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c449197-a13e-4bd3-8107-26ac3745bb49 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.114335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c449197-a13e-4bd3-8107-26ac3745bb49 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.150074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.150706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.150984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.151253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.161577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:53.166281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:53.167336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:53.168255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 530/1089] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:53.173956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.193207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.241497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.275095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b869b1c-ca0b-416f-a651-92b498e1a65d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.297032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b0376-6521-49d3-a71b-336beaea4671 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.309154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.309758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.310036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.310304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.310966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:53.311264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.312646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.326292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 560/1090] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:53.327512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.332864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.333499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.333771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.334036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.344637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:53.345057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:53.349752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:53.350706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:53.351580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 531/1091] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:53.356814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.433100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564fe5-56ee-48da-9b87-ea4598c41d29 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.458687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24cf50-7f46-4ffa-8782-3865bbfece6b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.466328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.466853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.467510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.467772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.468035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] PATH_INFO: `/v3/users/bcc2f91982194375b80b7ac236d32ba5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.469249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] RBAC: Authorizing `identity:get_user(user_id=bcc2f91982194375b80b7ac236d32ba5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.470672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.472268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 561/1092] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/users/bcc2f91982194375b80b7ac236d32ba5 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:53.478301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.493769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.494397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.494672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.494942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.495606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:53.495906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.497299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.505413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 532/1093] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:53.511953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.560774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.576722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1add1d5-beb1-4411-a6a5-3c8f2f18b032 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.608012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158460b0-9e2d-423e-9d33-d5c11864d454 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.609737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.610346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.610623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.610887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.642633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.643336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.643561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.643833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.654309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.655739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:53.669991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:53.670991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:53.671898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:53.671898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:53.671898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:53.671898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 533/1094] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:53.675879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.676957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.677355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.701209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.759678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.776096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 562/1095] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:53.781299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df926ae-e96e-497d-8382-49b01952136d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.782476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.814555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.815071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.815346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.815614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.816252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:53.816551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.817942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.829366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 534/1096] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:53.835004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.876515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ba6fa-d038-41d1-b468-2a214ead8711 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.910281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.910664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.911635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.912017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.912210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.913375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] RBAC: Authorizing `identity:get_project(project_id=18b2a1dd3a7d4e708d037bcab4589eb7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.914931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.921743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 563/1097] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:53.922645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.929503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03e1b-0b70-4c2b-bd95-c5fc088ed4e0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.963377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.964008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.964280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.964546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.972490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.974339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.974599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:53.987273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:53.988776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:53.989729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 535/1098] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:53.998790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.029722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d90499-01ae-4ca6-baaa-5ad61a41467b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.067754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.068336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.068635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.068912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.069623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7, user.id=bcc2f91982194375b80b7ac236d32ba5) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:54.069926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.071354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.077158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 564/1099] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/role_assignments?user.id=bcc2f91982194375b80b7ac236d32ba5&scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:54.104757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348159e0-d15c-4928-bdab-eaef905a8962 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.143450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.144215 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.144491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.144772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.145525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:54.145821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.147423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.158728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:54.168057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 536/1100] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:54.174502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.283388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61117554-75be-4404-b8bc-fbbfd41245b5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.299399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:54.317689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.318370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.318583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.318857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.394286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.396572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.503328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 565/1101] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:54.509274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.619028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44844f0e-3e4c-40d9-b434-7985f1da8970 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.653675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.654331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.654559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.654825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.667570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.669054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:54.687487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:54.688687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:54.689855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:54.689855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:54.689855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:54.689855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 537/1102] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:54.695910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.714917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:54.801743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c4316-75d1-4de9-8b0c-3c5443eee131 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.836315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.836945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.837198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.837484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:54.838120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:54.838423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:54.839765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:54.851356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 566/1103] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:54.857207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:54.909708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:54.960683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27682c5-7483-43be-9992-cf4913c8dbf9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:54.998040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:54.998658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:54.998948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:54.999207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:55.006272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:55.007706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:55.019069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:55.020010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:45:55.020940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 538/1104] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:55.027738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:55.106034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:55.129385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdb3dd-d002-4fb2-a951-d9c12e2017d8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:55.163482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:55.164028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:55.164308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:55.164579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:55.165303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:55.165608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:55.167048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a2af-09f4-4b2c-a0cd-9c67cdce1f3c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:55.179601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 567/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:55.185875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:55.286467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75854041-ae70-4dc3-8390-1b4750fa0300 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:55.296850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:55.320593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:55.321229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:55.321513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:55.321766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:55.322487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] RBAC: Adding query filter params (role.id=db2af065cbd9498a8113a2c2a33ff59b, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=3a919420853a4ac8b461e303fc993429) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:55.322793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:55.324220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e1149-f450-4c42-a5ba-1f72cf5ce4a2 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:55.330594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 539/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:55 2022] GET /identity/v3/role_assignments?user.id=3a919420853a4ac8b461e303fc993429&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=db2af065cbd9498a8113a2c2a33ff59b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:56.231980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f2dff-5ca1-49cb-93ee-298a8d2b77fa None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:56.232844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f2dff-5ca1-49cb-93ee-298a8d2b77fa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:56.232844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f2dff-5ca1-49cb-93ee-298a8d2b77fa None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:56.235025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 568/1107] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:56.241758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:56.242184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:56.242324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:56.265497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:56.266697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:56.344757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 540/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:56.623471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f2dff-5ca1-49cb-93ee-298a8d2b77fa None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:56.735350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f2dff-5ca1-49cb-93ee-298a8d2b77fa None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:56.771059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144771d-02a9-41a5-b77b-7cd0b5986f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:56.771670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144771d-02a9-41a5-b77b-7cd0b5986f50 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:56.771946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144771d-02a9-41a5-b77b-7cd0b5986f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:56.772311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144771d-02a9-41a5-b77b-7cd0b5986f50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:56.773574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144771d-02a9-41a5-b77b-7cd0b5986f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:56.774998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144771d-02a9-41a5-b77b-7cd0b5986f50 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:56.776549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 569/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:56.782731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:56.883891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c87b4-87cf-4a30-9b1d-5e039f2bb40c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:56.886119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:56.924952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a98c83-d1b1-4680-8e48-28661f201db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:56.925551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a98c83-d1b1-4680-8e48-28661f201db0 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:56.925821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a98c83-d1b1-4680-8e48-28661f201db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:56.926089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a98c83-d1b1-4680-8e48-28661f201db0 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:56.926735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a98c83-d1b1-4680-8e48-28661f201db0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:56.928169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a98c83-d1b1-4680-8e48-28661f201db0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:56.951170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 541/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:56 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:59.109384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62910b-f6c3-4253-99c1-e76a025e8b21 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:59.109977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62910b-f6c3-4253-99c1-e76a025e8b21 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:59.109977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62910b-f6c3-4253-99c1-e76a025e8b21 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:59.111351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 570/1111] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:59.117869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:59.118325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:59.118419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:59.142925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:59.144120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:59.217766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 542/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:59.490449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62910b-f6c3-4253-99c1-e76a025e8b21 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:59.495235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:59.605688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62910b-f6c3-4253-99c1-e76a025e8b21 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:59.642891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:59.643539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:59.643812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:59.644082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] PATH_INFO: `/v3/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:59.645592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] RBAC: Authorizing `identity:get_role(role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:59.646938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:59.648264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 571/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:59 2022] GET /identity/v3/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:59.657519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:59.763869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:59.781355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c52ed-87eb-412e-93ad-f04b4ecded8f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:59.837305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:59.837937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:59.838214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:59.838483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] PATH_INFO: `/v3/users/fc661378c0354eb7baf77f1b3f7c0330` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:59.852330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] RBAC: Authorizing `identity:get_user(user_id=fc661378c0354eb7baf77f1b3f7c0330)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:59.853815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:59.855420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 543/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:59 2022] GET /identity/v3/users/fc661378c0354eb7baf77f1b3f7c0330 => generated 286 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:59.861933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:59.945135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:59.977306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449092c1-0790-4e56-8f1f-3c160ea4316b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:00.015954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:00.016671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:00.016929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:00.017229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:00.089277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:00.090724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:00.165838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:00.205724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 572/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:00.212152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:00.337476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b952e2-fd6c-4424-be7f-0e42f7c9cd96 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:00.378562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac1698-7732-4bf5-8082-94023d9dcdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:00.379181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac1698-7732-4bf5-8082-94023d9dcdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:00.379457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac1698-7732-4bf5-8082-94023d9dcdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:00.379724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac1698-7732-4bf5-8082-94023d9dcdb7 None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:00.380926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac1698-7732-4bf5-8082-94023d9dcdb7 None admin] RBAC: Authorizing `identity:get_project(project_id=18b2a1dd3a7d4e708d037bcab4589eb7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:00.382359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac1698-7732-4bf5-8082-94023d9dcdb7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:00.383991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 544/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:00 2022] GET /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:00.391906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:00.514969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08fb54-7b8d-46e9-aa37-89c365be37f5 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:00.558021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:00.558631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:00.558912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:00.559187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:00.559924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] RBAC: Adding query filter params (role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7, user.id=fc661378c0354eb7baf77f1b3f7c0330) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:00.560234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:00.561699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a0a85-62e9-4318-a964-4291fc1516c5 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:00.567416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 573/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:00 2022] GET /identity/v3/role_assignments?user.id=fc661378c0354eb7baf77f1b3f7c0330&scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:02.669635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0e6dd-6747-4312-91ab-4f815939fcb2 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:02.670226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0e6dd-6747-4312-91ab-4f815939fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:02.670226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0e6dd-6747-4312-91ab-4f815939fcb2 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:02.671489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 545/1118] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:02.677943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:02.678678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:02.678835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:02.706671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:02.707801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:02.737238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:02.780768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 574/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:03.045289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0e6dd-6747-4312-91ab-4f815939fcb2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:03.068147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:03.163879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa0e6dd-6747-4312-91ab-4f815939fcb2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:03.198611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:03.199233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:03.199505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:03.199766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] PATH_INFO: `/v3/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:03.201292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] RBAC: Authorizing `identity:get_role(role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:03.202996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:03.204343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 546/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:03 2022] GET /identity/v3/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:03.211238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:03.312489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96167f1e-2459-4f23-93fa-00662397a986 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:03.347022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:03.347632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:03.347902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:03.348169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] PATH_INFO: `/v3/users/fc661378c0354eb7baf77f1b3f7c0330` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:03.349391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] RBAC: Authorizing `identity:get_user(user_id=fc661378c0354eb7baf77f1b3f7c0330)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:03.350814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:03.352374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 575/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:03 2022] GET /identity/v3/users/fc661378c0354eb7baf77f1b3f7c0330 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:03.358403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:03.466740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:03.484410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42364d50-dbe5-4301-8192-7bc38c6c86a3 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:03.519942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb003-44f3-49c5-8606-9eb30fbb3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:03.520571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb003-44f3-49c5-8606-9eb30fbb3cae None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:03.520882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb003-44f3-49c5-8606-9eb30fbb3cae None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:03.521148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb003-44f3-49c5-8606-9eb30fbb3cae None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:03.522289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb003-44f3-49c5-8606-9eb30fbb3cae None admin] RBAC: Authorizing `identity:get_project(project_id=18b2a1dd3a7d4e708d037bcab4589eb7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:03.523719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb003-44f3-49c5-8606-9eb30fbb3cae None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:03.525373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 547/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:03 2022] GET /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:03.532175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:03.572294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:03.642246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468e19-e0ee-4aad-93a1-7f2fb3c33f2f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:03.678597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9ec0b-728b-490a-b1e7-9fd0942d3aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:03.679211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9ec0b-728b-490a-b1e7-9fd0942d3aa3 None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:03.679501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9ec0b-728b-490a-b1e7-9fd0942d3aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:03.679781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9ec0b-728b-490a-b1e7-9fd0942d3aa3 None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7/users/fc661378c0354eb7baf77f1b3f7c0330/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:03.682325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9ec0b-728b-490a-b1e7-9fd0942d3aa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=18b2a1dd3a7d4e708d037bcab4589eb7, user_id=fc661378c0354eb7baf77f1b3f7c0330, role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:03.683765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9ec0b-728b-490a-b1e7-9fd0942d3aa3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:03.698914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 576/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:46:03 2022] PUT /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7/users/fc661378c0354eb7baf77f1b3f7c0330/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:46:05.773708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76cd6-c7a8-4460-830e-b56ee6351967 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:05.774254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76cd6-c7a8-4460-830e-b56ee6351967 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:05.774254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76cd6-c7a8-4460-830e-b56ee6351967 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:05.775555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 548/1124] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:05.782210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:05.782990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:05.783163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:05.807726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:05.808938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:05.878038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 577/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:06.147248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76cd6-c7a8-4460-830e-b56ee6351967 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:06.263970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76cd6-c7a8-4460-830e-b56ee6351967 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:06.299131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:06.299750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:06.300025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:06.300296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] PATH_INFO: `/v3/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:06.301749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] RBAC: Authorizing `identity:get_role(role_id=d1b5ef817f65407ca9c2d9b3c8a7fa47)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:06.303119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:06.304416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 549/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:06 2022] GET /identity/v3/roles/d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:06.313566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:06.337934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:06.430011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb3ca-3d37-434d-9be9-cb1f7b472442 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:06.473201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:06.473832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:06.474106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:06.474372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] PATH_INFO: `/v3/users/fc661378c0354eb7baf77f1b3f7c0330` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:06.475552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] RBAC: Authorizing `identity:get_user(user_id=fc661378c0354eb7baf77f1b3f7c0330)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:06.476991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:06.478605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 578/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:06 2022] GET /identity/v3/users/fc661378c0354eb7baf77f1b3f7c0330 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:06.484663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:06.510752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:06.595406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3689c3a-4bc7-4c4c-abdd-47bd96d74bd9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:06.631003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:06.631600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:06.631871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:06.632140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:06.713027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:06.714388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:06.735278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:06.822327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 550/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:06.832022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:06.924358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:06.933542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2344924-6079-4981-848c-db1dc8090d02 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:06.968978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc39290-fd69-4703-92ac-05c358ffc4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:06.969630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39290-fd69-4703-92ac-05c358ffc4bf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:06.969908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39290-fd69-4703-92ac-05c358ffc4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:06.970178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc39290-fd69-4703-92ac-05c358ffc4bf None admin] PATH_INFO: `/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:06.971358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39290-fd69-4703-92ac-05c358ffc4bf None admin] RBAC: Authorizing `identity:get_project(project_id=18b2a1dd3a7d4e708d037bcab4589eb7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:06.972832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc39290-fd69-4703-92ac-05c358ffc4bf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:06.974433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 579/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:06 2022] GET /identity/v3/projects/18b2a1dd3a7d4e708d037bcab4589eb7 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:06.981073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:07.082119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ceef10-54d7-4db4-be20-2ad0fbc49a3b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:07.104418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:07.126199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:07.127134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:07.127579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:07.128016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:07.129233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] RBAC: Adding query filter params (role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47, scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7, user.id=fc661378c0354eb7baf77f1b3f7c0330) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:07.129736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:07.132050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04583c5-8737-45e5-b0bb-0feb4aa26d34 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:07.142016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 551/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:06 2022] GET /identity/v3/role_assignments?user.id=fc661378c0354eb7baf77f1b3f7c0330&scope.project.id=18b2a1dd3a7d4e708d037bcab4589eb7&role.id=d1b5ef817f65407ca9c2d9b3c8a7fa47 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:09.298420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890ac51-1b6b-4fb3-b3d4-580e3ef75136 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:09.299336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890ac51-1b6b-4fb3-b3d4-580e3ef75136 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:09.299336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890ac51-1b6b-4fb3-b3d4-580e3ef75136 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:09.301458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 580/1131] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:09.310398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:09.310811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:09.310985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:09.330855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:09.332047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:09.406074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 552/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:09.683151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890ac51-1b6b-4fb3-b3d4-580e3ef75136 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:09.793363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890ac51-1b6b-4fb3-b3d4-580e3ef75136 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:09.828724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ab96b-6141-474f-b1f8-2bd0377161ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:09.829335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab96b-6141-474f-b1f8-2bd0377161ff None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:09.829603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab96b-6141-474f-b1f8-2bd0377161ff None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:09.829861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab96b-6141-474f-b1f8-2bd0377161ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:09.831012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ab96b-6141-474f-b1f8-2bd0377161ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:09.832416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ab96b-6141-474f-b1f8-2bd0377161ff None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:09.833996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 581/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:46:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:09.840836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:09.961859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bff03-44a5-4a1f-bfa0-ae393129de61 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:09.975828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:09.998431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690a597-7316-41b1-887a-d178549a3cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:09.999032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a597-7316-41b1-887a-d178549a3cd8 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:09.999309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a597-7316-41b1-887a-d178549a3cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:09.999581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a597-7316-41b1-887a-d178549a3cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:10.000224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690a597-7316-41b1-887a-d178549a3cd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:10.001751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690a597-7316-41b1-887a-d178549a3cd8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:10.033763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 553/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:46:09 2022] POST /identity/v3/projects => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:12.233682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a690-9ae0-40b1-80fe-efcf3a13d14b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:12.234259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a690-9ae0-40b1-80fe-efcf3a13d14b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:12.234259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a690-9ae0-40b1-80fe-efcf3a13d14b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:12.235835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 582/1135] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:12.242210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:12.242653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:12.242743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:12.268005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:12.269586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:12.339752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 554/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:12.608420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a690-9ae0-40b1-80fe-efcf3a13d14b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:12.652203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:12.728920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a690-9ae0-40b1-80fe-efcf3a13d14b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:12.764559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c65fc1-202a-4923-bfae-046683d57643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:12.765205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65fc1-202a-4923-bfae-046683d57643 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:12.765484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65fc1-202a-4923-bfae-046683d57643 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:12.765742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c65fc1-202a-4923-bfae-046683d57643 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:12.766885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65fc1-202a-4923-bfae-046683d57643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:12.768292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c65fc1-202a-4923-bfae-046683d57643 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:12.769884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 583/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:46:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:12.778947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:12.872350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:12.879454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc108834-fe61-482b-b8a4-972ae958969f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:12.914960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cd5be-2e86-47f5-a61a-5d781933a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:12.915563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cd5be-2e86-47f5-a61a-5d781933a8ba None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:12.915838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cd5be-2e86-47f5-a61a-5d781933a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:12.916106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cd5be-2e86-47f5-a61a-5d781933a8ba None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:12.916783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cd5be-2e86-47f5-a61a-5d781933a8ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:12.918224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cd5be-2e86-47f5-a61a-5d781933a8ba None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:12.944444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 555/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:46:12 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:15.153005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666315-e8e6-48bd-8419-3b4cf885c1c5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:15.153604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666315-e8e6-48bd-8419-3b4cf885c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:15.153604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666315-e8e6-48bd-8419-3b4cf885c1c5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:15.154902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 584/1139] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:15.161408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:15.162130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:15.162415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:15.190979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:15.192197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:15.270048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 556/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:15.534046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666315-e8e6-48bd-8419-3b4cf885c1c5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:15.642698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:15.650337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666315-e8e6-48bd-8419-3b4cf885c1c5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:15.685038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:15.685657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:15.685932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:15.686201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:15.696439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:15.701247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:15.702353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:46:15.703339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 585/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:15.708677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:15.794580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:15.822658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d0010-e88d-456a-9890-7396df61c0f0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:15.857177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:15.857768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:15.858037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:15.858295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:15.858941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:15.859235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:15.860656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:15.871384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 557/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:15.877480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:16.000840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5cfb-f573-4909-9169-b07d9861ce72 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:16.037503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:16.038128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:16.038399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:16.038663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] PATH_INFO: `/v3/users/af2080acf0bd41428ffe20b379d20fce` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:16.051296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] RBAC: Authorizing `identity:get_user(user_id=af2080acf0bd41428ffe20b379d20fce)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:16.052755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:16.054333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 586/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:15 2022] GET /identity/v3/users/af2080acf0bd41428ffe20b379d20fce => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:16.063611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:16.168278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500c208-6ee7-48a3-b0dc-b1577ae03fc7 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:16.202878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:16.203473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:16.203805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:16.204072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:16.218327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:16.273350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:16.274747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:16.386849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 558/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:16.393377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:16.411697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:16.500177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6589a07-a8f2-42d7-8286-6dbc117a6f43 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:16.535211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834dc9-bd17-4130-8e39-dda939d8085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:16.535764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834dc9-bd17-4130-8e39-dda939d8085b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:16.536040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834dc9-bd17-4130-8e39-dda939d8085b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:16.536308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834dc9-bd17-4130-8e39-dda939d8085b None admin] PATH_INFO: `/v3/projects/8fdda40f11954795ae231ef1e423c1f7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:16.537578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834dc9-bd17-4130-8e39-dda939d8085b None admin] RBAC: Authorizing `identity:get_project(project_id=8fdda40f11954795ae231ef1e423c1f7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:16.538993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834dc9-bd17-4130-8e39-dda939d8085b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:16.540647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 587/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:16 2022] GET /identity/v3/projects/8fdda40f11954795ae231ef1e423c1f7 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:16.547199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:16.598410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:16.667519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61275-32b4-4bb5-94ca-19a2b1bc498a None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:16.708433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:16.709090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:16.709358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:16.709624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:16.710346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=8fdda40f11954795ae231ef1e423c1f7, user.id=af2080acf0bd41428ffe20b379d20fce) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:16.710650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:16.712081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5664-52ab-44db-b497-5f8b6063bfff None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:16.717527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 559/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:16 2022] GET /identity/v3/role_assignments?user.id=af2080acf0bd41428ffe20b379d20fce&scope.project.id=8fdda40f11954795ae231ef1e423c1f7&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:18.805111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3653a5-dd6b-4314-bc3e-35a0d3e17258 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:18.805672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3653a5-dd6b-4314-bc3e-35a0d3e17258 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:18.805672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3653a5-dd6b-4314-bc3e-35a0d3e17258 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:18.807011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 588/1147] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:18.813613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:18.814292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:18.814430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:18.845649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:18.846820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:18.919735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 560/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:19.184310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3653a5-dd6b-4314-bc3e-35a0d3e17258 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:19.270658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:19.289828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3653a5-dd6b-4314-bc3e-35a0d3e17258 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:19.328059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:19.328734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:19.329034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:19.329303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:19.341132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:19.345941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:19.346997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:46:19.347940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 589/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:19.354173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:19.398519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:19.472346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f668-eeee-4c82-9316-7258cc32147b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:19.508491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:19.509127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:19.509398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:19.509662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:19.510313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:19.510609 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:19.511985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:19.520181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 561/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:19.529571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:19.633982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c553b-aecc-4783-9ad6-2f3a6ff2247b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:19.668869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:19.669477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:19.669753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:19.670021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] PATH_INFO: `/v3/users/af2080acf0bd41428ffe20b379d20fce` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:19.671178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] RBAC: Authorizing `identity:get_user(user_id=af2080acf0bd41428ffe20b379d20fce)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:19.672605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:19.674206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 590/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:19 2022] GET /identity/v3/users/af2080acf0bd41428ffe20b379d20fce => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:19.680233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:19.791089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:19.794452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1ff4b-726b-40d4-88ca-d8c5a5c9d226 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:19.829213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b710c-a9a5-492f-b880-f0e11e25a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:19.829839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b710c-a9a5-492f-b880-f0e11e25a594 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:19.830100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b710c-a9a5-492f-b880-f0e11e25a594 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:19.830367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b710c-a9a5-492f-b880-f0e11e25a594 None admin] PATH_INFO: `/v3/projects/8fdda40f11954795ae231ef1e423c1f7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:19.831514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b710c-a9a5-492f-b880-f0e11e25a594 None admin] RBAC: Authorizing `identity:get_project(project_id=8fdda40f11954795ae231ef1e423c1f7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:19.832980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b710c-a9a5-492f-b880-f0e11e25a594 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:19.834596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 562/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:19 2022] GET /identity/v3/projects/8fdda40f11954795ae231ef1e423c1f7 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:19.840925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:19.853952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:19.940076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fe537-e772-41a1-8051-c8930e7e78e3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:19.975495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fac0d4-69dd-4177-b1ec-2bba70e42afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:19.976137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac0d4-69dd-4177-b1ec-2bba70e42afe None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:19.976412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac0d4-69dd-4177-b1ec-2bba70e42afe None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:19.976707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fac0d4-69dd-4177-b1ec-2bba70e42afe None admin] PATH_INFO: `/v3/projects/8fdda40f11954795ae231ef1e423c1f7/users/af2080acf0bd41428ffe20b379d20fce/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:19.978834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fac0d4-69dd-4177-b1ec-2bba70e42afe None admin] RBAC: Authorizing `identity:create_grant(project_id=8fdda40f11954795ae231ef1e423c1f7, user_id=af2080acf0bd41428ffe20b379d20fce, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:19.980248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fac0d4-69dd-4177-b1ec-2bba70e42afe None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:19.995991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 591/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:46:19 2022] PUT /identity/v3/projects/8fdda40f11954795ae231ef1e423c1f7/users/af2080acf0bd41428ffe20b379d20fce/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:46:22.099485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4817a-e768-4375-a2af-1cfbca25805c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:22.100090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4817a-e768-4375-a2af-1cfbca25805c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:22.100090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4817a-e768-4375-a2af-1cfbca25805c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:22.101406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 563/1154] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:22.107960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:22.108724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:22.108915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:22.130979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:22.132200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:22.194798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:22.203036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 592/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:22.467628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4817a-e768-4375-a2af-1cfbca25805c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:22.580266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4817a-e768-4375-a2af-1cfbca25805c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:22.615110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:22.615710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:22.615984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:22.616256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:22.627090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:22.631854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:22.632935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:46:22.633822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 564/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:22.641160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:22.742081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec552-a984-4bd2-b876-073bd51b27ce None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:22.780293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:22.780917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:22.781188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:22.781449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:22.782199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:22.782495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:22.783831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:22.791719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 593/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:22.800329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:22.831535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:22.906445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fc0a6-eefa-477c-92e6-c3760229f738 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:22.941786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:22.942414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:22.942688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:22.942961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] PATH_INFO: `/v3/users/af2080acf0bd41428ffe20b379d20fce` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:22.944201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] RBAC: Authorizing `identity:get_user(user_id=af2080acf0bd41428ffe20b379d20fce)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:22.945693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:22.947248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 565/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:22 2022] GET /identity/v3/users/af2080acf0bd41428ffe20b379d20fce => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:22.954997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:23.022190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:23.065079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b144145-0c4c-4020-900f-33ba2c1b103b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:23.100982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:23.101585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:23.101861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:23.102119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:23.172229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:23.173747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:23.234416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:23.275822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 594/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:23.282335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:23.392347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:23.402404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab58b4-c0fc-41dc-b8ec-bf17dabb7c2c None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:23.440454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40187-c52d-41b9-8920-135b532bc1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:23.441236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40187-c52d-41b9-8920-135b532bc1de None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:23.441553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40187-c52d-41b9-8920-135b532bc1de None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:23.441764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40187-c52d-41b9-8920-135b532bc1de None admin] PATH_INFO: `/v3/projects/8fdda40f11954795ae231ef1e423c1f7` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:23.442994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40187-c52d-41b9-8920-135b532bc1de None admin] RBAC: Authorizing `identity:get_project(project_id=8fdda40f11954795ae231ef1e423c1f7)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:23.444449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e40187-c52d-41b9-8920-135b532bc1de None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:23.446141 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 566/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:23 2022] GET /identity/v3/projects/8fdda40f11954795ae231ef1e423c1f7 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:23.452465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:23.558886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7bc3d-9ef8-4ca7-9242-5464597f62cf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:23.593921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:23.594641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:23.594921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:23.595193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:23.595917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=8fdda40f11954795ae231ef1e423c1f7, user.id=af2080acf0bd41428ffe20b379d20fce) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:23.596226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:23.597705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622f605-6c41-40fb-b8fb-8a57dfdda455 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:23.606141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 595/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:23 2022] GET /identity/v3/role_assignments?user.id=af2080acf0bd41428ffe20b379d20fce&scope.project.id=8fdda40f11954795ae231ef1e423c1f7&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:25.784578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadeb14-676d-4d70-8fda-535c14ad2c2b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:25.785175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadeb14-676d-4d70-8fda-535c14ad2c2b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:25.785175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadeb14-676d-4d70-8fda-535c14ad2c2b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:25.786788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 567/1162] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:25.793272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:25.794034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:25.794136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:25.819970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:25.821198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:25.845048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:25.898250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 596/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:26.163458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadeb14-676d-4d70-8fda-535c14ad2c2b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:26.280198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadeb14-676d-4d70-8fda-535c14ad2c2b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:26.314372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:26.315018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:26.315291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:26.315559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:26.346078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:26.386514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:26.387960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:26.490293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 568/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:26.496467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:26.592804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237c395-ecb8-41f3-abfa-2a3de5b747c2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:26.627703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:26.628318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:26.628588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:26.628881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:26.635721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:26.637183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-f0b7a0e2-a7ea-4db0-92e6-896ec9a11cc8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:26.648663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:26.649857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:46:26.651099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 597/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:46:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:26.656377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:26.719688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:26.758191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0168ea-c89f-40da-962b-372f60f22618 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:26.795668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:26.796295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:26.796504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:26.796801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:26.797427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:26.797718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:26.799128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92f85f-ed4d-4b11-91cb-bce584308af7 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:26.806125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 569/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Sep 13 19:46:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:28.939442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af41c4-0ce7-4c51-95e1-7c103c2ebb71 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:28.940348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af41c4-0ce7-4c51-95e1-7c103c2ebb71 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:28.940663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af41c4-0ce7-4c51-95e1-7c103c2ebb71 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:28.942845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 598/1167] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:28.951695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9665a6d-ae09-4986-8d65-787bb8220832 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:28.952426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9665a6d-ae09-4986-8d65-787bb8220832 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:28.952583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9665a6d-ae09-4986-8d65-787bb8220832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:28.973701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d9665a6d-ae09-4986-8d65-787bb8220832 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:28.974901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d9665a6d-ae09-4986-8d65-787bb8220832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:29.050621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 570/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:29.315450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af41c4-0ce7-4c51-95e1-7c103c2ebb71 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:29.347436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:29.434631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af41c4-0ce7-4c51-95e1-7c103c2ebb71 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:29.471291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4598dfd6-6f57-4303-b20f-7b777964f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:29.471900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598dfd6-6f57-4303-b20f-7b777964f244 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:29.472177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598dfd6-6f57-4303-b20f-7b777964f244 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:29.472453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4598dfd6-6f57-4303-b20f-7b777964f244 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:29.473149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598dfd6-6f57-4303-b20f-7b777964f244 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:29.474531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4598dfd6-6f57-4303-b20f-7b777964f244 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:29.498228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 599/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Tue Sep 13 19:46:29 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:31.661383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27c05a-95e4-48c4-a1dc-3c9bad92e808 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:31.662282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27c05a-95e4-48c4-a1dc-3c9bad92e808 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:31.662282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27c05a-95e4-48c4-a1dc-3c9bad92e808 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:31.664482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 571/1170] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:31.673340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:31.674112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:31.674265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:31.700171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:31.701339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:31.786506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 600/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:32.054980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27c05a-95e4-48c4-a1dc-3c9bad92e808 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:32.119668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:32.163946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27c05a-95e4-48c4-a1dc-3c9bad92e808 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:32.207884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd531db-da32-4fde-9fbd-8bf7e284faf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:32.208524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd531db-da32-4fde-9fbd-8bf7e284faf4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:32.208832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd531db-da32-4fde-9fbd-8bf7e284faf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:32.209097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd531db-da32-4fde-9fbd-8bf7e284faf4 None admin] PATH_INFO: `/v3/domains/848cce5577d1454ca4ed9d6f343a1a2b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:32.219935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd531db-da32-4fde-9fbd-8bf7e284faf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=848cce5577d1454ca4ed9d6f343a1a2b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:32.221483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd531db-da32-4fde-9fbd-8bf7e284faf4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:32.223156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 572/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Tue Sep 13 19:46:32 2022] GET /identity/v3/domains/848cce5577d1454ca4ed9d6f343a1a2b => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:32.229659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:32.237937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:32.336274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2b18c-fdf3-4bf3-8589-06401a00e93b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:32.371200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ee992-df17-4a48-abb7-0665a9090d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:32.371737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee992-df17-4a48-abb7-0665a9090d09 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:32.372008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee992-df17-4a48-abb7-0665a9090d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:32.372274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ee992-df17-4a48-abb7-0665a9090d09 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:32.372941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ee992-df17-4a48-abb7-0665a9090d09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:32.374346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ee992-df17-4a48-abb7-0665a9090d09 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:32.409019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 601/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:46:32 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:46:34.557350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3bc3-6ad5-467b-84b3-62e9bca837e0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:34.558404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3bc3-6ad5-467b-84b3-62e9bca837e0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:34.558404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3bc3-6ad5-467b-84b3-62e9bca837e0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:34.560327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 573/1174] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:34.565951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:34.566492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:34.566598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:34.586545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:34.587719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:34.643080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:34.660286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 602/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:34.947786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3bc3-6ad5-467b-84b3-62e9bca837e0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:35.070705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3bc3-6ad5-467b-84b3-62e9bca837e0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:35.087669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:35.106743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bd27e-3c2c-4cd0-9092-be27cd9661c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:35.107360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd27e-3c2c-4cd0-9092-be27cd9661c8 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:35.107629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd27e-3c2c-4cd0-9092-be27cd9661c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:35.107895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bd27e-3c2c-4cd0-9092-be27cd9661c8 None admin] PATH_INFO: `/v3/domains/848cce5577d1454ca4ed9d6f343a1a2b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:35.109079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bd27e-3c2c-4cd0-9092-be27cd9661c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=848cce5577d1454ca4ed9d6f343a1a2b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:35.110512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bd27e-3c2c-4cd0-9092-be27cd9661c8 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:35.112067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 574/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Tue Sep 13 19:46:34 2022] GET /identity/v3/domains/848cce5577d1454ca4ed9d6f343a1a2b => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:35.118852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:35.233729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01544d-379a-4b63-a7f3-13d7320f9ff4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:35.271709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb955e8f-a752-47cf-b212-1f2924d19d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:35.272303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb955e8f-a752-47cf-b212-1f2924d19d34 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:35.272573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb955e8f-a752-47cf-b212-1f2924d19d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:35.272866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb955e8f-a752-47cf-b212-1f2924d19d34 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:35.273509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb955e8f-a752-47cf-b212-1f2924d19d34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:35.274922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb955e8f-a752-47cf-b212-1f2924d19d34 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:35.303299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 603/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:46:35 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:37.445157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18c5bd-8b05-48a0-855d-30685bee4741 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:37.445628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18c5bd-8b05-48a0-855d-30685bee4741 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:37.445628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18c5bd-8b05-48a0-855d-30685bee4741 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:37.447018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 575/1178] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:37.452485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:37.452956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:37.453053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:37.471743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:37.472978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:37.513747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:37.541622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 604/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:37.805401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18c5bd-8b05-48a0-855d-30685bee4741 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:37.915948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18c5bd-8b05-48a0-855d-30685bee4741 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:37.951596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:37.952216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:37.952495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:37.952792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:37.964054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:37.968866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:37.969947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:46:37.970835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 576/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:37.976147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:38.078646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dfc89-0137-47e0-bccf-75783676b3a8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:38.119119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:38.119905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:38.120443 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:38.120838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:38.121708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:38.122012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:38.123881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:38.133403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 605/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:38.139610 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:38.188755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:38.244245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a01f3-91a5-4980-9aaa-d1866ce49efb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:38.295155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:38.296061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:38.296449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:38.296797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] PATH_INFO: `/v3/users/650b383bca4940989ea4752c22e9dcc3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:38.319305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] RBAC: Authorizing `identity:get_user(user_id=650b383bca4940989ea4752c22e9dcc3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:38.320776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:38.322357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 577/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:38 2022] GET /identity/v3/users/650b383bca4940989ea4752c22e9dcc3 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:38.328496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:38.364800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:38.434794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f95f24-9228-458c-94ec-ae032076eff6 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:38.470855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:38.471458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:38.471718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:38.471986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:38.540488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:38.542734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:38.581198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:38.651605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 606/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:38.658505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:38.774401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3764f-569d-49a3-a2fb-b6573ddb75f6 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:38.776762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:38.810766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527463eb-45ef-4b28-a6c0-f1e5f12795b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:38.811375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527463eb-45ef-4b28-a6c0-f1e5f12795b1 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:38.811644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527463eb-45ef-4b28-a6c0-f1e5f12795b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:38.811912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527463eb-45ef-4b28-a6c0-f1e5f12795b1 None admin] PATH_INFO: `/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:38.813079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527463eb-45ef-4b28-a6c0-f1e5f12795b1 None admin] RBAC: Authorizing `identity:get_project(project_id=86a3460e1ce34ffa8c9b1c6b5a4d615a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:38.814499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527463eb-45ef-4b28-a6c0-f1e5f12795b1 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:38.816094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 578/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:38 2022] GET /identity/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:38.822626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:38.945707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05439e10-1ac8-4765-96f4-8254d55ce7dd None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:38.980386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:38.981006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:38.981278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:38.981543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:38.982300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=86a3460e1ce34ffa8c9b1c6b5a4d615a, user.id=650b383bca4940989ea4752c22e9dcc3) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:38.982606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:38.984013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f897ad2-93b6-4ec7-9be0-ac83c0c981d4 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:38.986856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:39.000725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 607/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:38 2022] GET /identity/v3/role_assignments?user.id=650b383bca4940989ea4752c22e9dcc3&scope.project.id=86a3460e1ce34ffa8c9b1c6b5a4d615a&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:41.107238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b4504-ae92-4214-a897-bad3bbee5e0a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:41.108160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b4504-ae92-4214-a897-bad3bbee5e0a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:41.108160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b4504-ae92-4214-a897-bad3bbee5e0a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:41.110222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 579/1186] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:41.119021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:41.119441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:41.119730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:41.143463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:41.144679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:41.215085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 608/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:41.489152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b4504-ae92-4214-a897-bad3bbee5e0a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:41.608521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b4504-ae92-4214-a897-bad3bbee5e0a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:41.650799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:41.651418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:41.651693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:41.651959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:41.662667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:41.667422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:41.668510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:46:41.669447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 580/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:41.677064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:41.789199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ddeb-628f-4a03-a786-295b4a5d2121 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:41.827640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:41.835217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:41.835833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:41.836111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:41.836383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:41.837086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:41.837384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:41.838769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:41.846787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 609/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:41.855949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:41.889535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:41.960993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8e271-e5ed-4813-abbb-fed99eb4e2ac None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:42.010373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:42.010984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:42.011256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:42.011525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] PATH_INFO: `/v3/users/650b383bca4940989ea4752c22e9dcc3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:42.012829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] RBAC: Authorizing `identity:get_user(user_id=650b383bca4940989ea4752c22e9dcc3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:42.014302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:42.015865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 581/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:41 2022] GET /identity/v3/users/650b383bca4940989ea4752c22e9dcc3 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:42.024323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:42.129692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f43fc-2296-40ba-8988-132c10216341 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:42.165879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6c1e1-31c5-4b3c-a6eb-926da30a13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:42.166503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6c1e1-31c5-4b3c-a6eb-926da30a13a1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:42.166781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6c1e1-31c5-4b3c-a6eb-926da30a13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:42.167049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6c1e1-31c5-4b3c-a6eb-926da30a13a1 None admin] PATH_INFO: `/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:42.168233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6c1e1-31c5-4b3c-a6eb-926da30a13a1 None admin] RBAC: Authorizing `identity:get_project(project_id=86a3460e1ce34ffa8c9b1c6b5a4d615a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:42.169689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6c1e1-31c5-4b3c-a6eb-926da30a13a1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:42.171328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 610/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:42 2022] GET /identity/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:42.180413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:42.282165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:42.285359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb327d-ba25-437c-a747-4e09b75a0a30 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:42.320319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b958cc9-88d7-4f34-8c9a-545b4d83ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:42.320991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b958cc9-88d7-4f34-8c9a-545b4d83ff57 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:42.321262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b958cc9-88d7-4f34-8c9a-545b4d83ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:42.321532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b958cc9-88d7-4f34-8c9a-545b4d83ff57 None admin] PATH_INFO: `/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a/users/650b383bca4940989ea4752c22e9dcc3/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:42.323680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b958cc9-88d7-4f34-8c9a-545b4d83ff57 None admin] RBAC: Authorizing `identity:create_grant(project_id=86a3460e1ce34ffa8c9b1c6b5a4d615a, user_id=650b383bca4940989ea4752c22e9dcc3, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:42.325151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b958cc9-88d7-4f34-8c9a-545b4d83ff57 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:42.342715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 582/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:46:42 2022] PUT /identity/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a/users/650b383bca4940989ea4752c22e9dcc3/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:46:44.440949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944eaa-e921-45a5-9cfc-753fc486b166 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:44.441516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944eaa-e921-45a5-9cfc-753fc486b166 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:44.441516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73944eaa-e921-45a5-9cfc-753fc486b166 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:44.442815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 611/1193] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:44.449296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:44.449726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:44.449817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:44.472498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:44.473716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:44.552898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 583/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:44.820545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73944eaa-e921-45a5-9cfc-753fc486b166 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:44.886162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:44.939789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73944eaa-e921-45a5-9cfc-753fc486b166 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:44.974343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:44.974948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:44.975220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:44.975552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:44.985998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:44.991211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:44.992303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:46:44.993368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 612/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:45.000200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:45.095932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:45.109807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d5f85-8214-4946-8239-b030fa6bd8a4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:45.149600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:45.150206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:45.150483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:45.150754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:45.151418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:45.151717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:45.153134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:45.161091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 584/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:45.168672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:45.281226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a5eaf-4ade-4660-a5e8-3738bbc22998 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:45.301552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:45.322254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:45.323128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:45.323476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:45.323806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] PATH_INFO: `/v3/users/650b383bca4940989ea4752c22e9dcc3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:45.325797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] RBAC: Authorizing `identity:get_user(user_id=650b383bca4940989ea4752c22e9dcc3)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:45.328004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:45.330540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 613/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:45 2022] GET /identity/v3/users/650b383bca4940989ea4752c22e9dcc3 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:45.336466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:45.447539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12e93a-b12f-481c-8740-0983ca5b7958 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:45.481319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:45.481896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:45.482179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:45.482442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:45.504193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:45.551749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:45.553303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:45.653445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 585/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:45.660396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:45.766953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa573e08-b7ce-4c16-9f41-e1bdeee978d3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:45.801529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd8872-b1d8-4457-b7f3-1bb01f26ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:45.802141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8872-b1d8-4457-b7f3-1bb01f26ff57 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:45.802413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8872-b1d8-4457-b7f3-1bb01f26ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:45.802678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8872-b1d8-4457-b7f3-1bb01f26ff57 None admin] PATH_INFO: `/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:45.803923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd8872-b1d8-4457-b7f3-1bb01f26ff57 None admin] RBAC: Authorizing `identity:get_project(project_id=86a3460e1ce34ffa8c9b1c6b5a4d615a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:45.805378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd8872-b1d8-4457-b7f3-1bb01f26ff57 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:45.806971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 614/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:45 2022] GET /identity/v3/projects/86a3460e1ce34ffa8c9b1c6b5a4d615a => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:45.816839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:45.873268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:45.922258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c2c6-2706-44f9-aea1-d9f7020536da None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:45.957242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:45.957831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:45.958102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:45.958369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:45.959082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=86a3460e1ce34ffa8c9b1c6b5a4d615a, user.id=650b383bca4940989ea4752c22e9dcc3) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:45.959386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:45.960939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0141b-6df3-402e-a5ee-8cf064969169 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:45.966689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 586/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:45 2022] GET /identity/v3/role_assignments?user.id=650b383bca4940989ea4752c22e9dcc3&scope.project.id=86a3460e1ce34ffa8c9b1c6b5a4d615a&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:55.796466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=72 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:55.963973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=42 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:41.975903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646710-e470-4814-95f4-e08865b875e5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.976515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646710-e470-4814-95f4-e08865b875e5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.976515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df646710-e470-4814-95f4-e08865b875e5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:41.977929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 615/1201] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:47:41.986022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.986773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.986773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.013941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:42.015184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:42.103463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 587/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:42.398587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646710-e470-4814-95f4-e08865b875e5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:42.535264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df646710-e470-4814-95f4-e08865b875e5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:42.577823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:42.578523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:42.578833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:42.579108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.592786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:42.594450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:42.610657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:42.611849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:42.612861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:42.612861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:42.612861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:47:42.612861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 616/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:47:42.618769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:42.754898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486fc3c-1db4-4206-aedb-0822fe388f19 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:42.788917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:42.796006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:42.796651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:42.797027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:42.797299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.798029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:42.798319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:42.799849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738821c-7c48-4dd1-b522-aa072a76938a None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:42.815966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 588/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:42.822552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:42.887541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:42.949422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88927b-1c80-47c6-a0de-8ba7a6b78d8d None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:42.995769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd1c0-d139-4362-918f-25cec7d03b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:42.996756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd1c0-d139-4362-918f-25cec7d03b45 None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:42.996756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd1c0-d139-4362-918f-25cec7d03b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:42.996931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd1c0-d139-4362-918f-25cec7d03b45 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.997647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd1c0-d139-4362-918f-25cec7d03b45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:42.999061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd1c0-d139-4362-918f-25cec7d03b45 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:43.028336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 617/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Sep 13 19:47:42 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:47:45.380222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116b50e-4a50-4881-a783-b9fd0c6ab565 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.380775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116b50e-4a50-4881-a783-b9fd0c6ab565 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.380775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116b50e-4a50-4881-a783-b9fd0c6ab565 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.382109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 589/1206] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:45.389623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.390086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.390205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.411800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:45.413052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:45.493004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 618/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:45.805710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116b50e-4a50-4881-a783-b9fd0c6ab565 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:45.938125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116b50e-4a50-4881-a783-b9fd0c6ab565 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.981748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.982717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.983179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.983650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.997501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:46.003121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:46.004202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:46.005126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 590/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:46.010988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.057269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.136777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce081661-254a-4de7-9e73-46e3b5139d9f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.180579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.181384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.181725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.182011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.182825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:46.183130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.184691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.194772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 619/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:46.201407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.257748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.314810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54118cb4-ae71-497f-b034-9191751cd776 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.354717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.355356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.355666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.355960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.368041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.370012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:46.384490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:46.386103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:46.387267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:46.387267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:46.387267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:46.393646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.394657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 591/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:46.498770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.502058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cbc22-49ab-46f1-8267-682f01609bb1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.538919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.539722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.539964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.540257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.541013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:46.541279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.542701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.559008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 620/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:46.560288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.667767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49f45-cf0e-47c9-b57b-7966b6be48aa None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.669884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.708543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.709728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.710311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.710832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.719924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.721889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:46.740039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:46.741787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:46.742787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 592/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:46.748653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.854970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55766f9-c4e4-47c8-ac9b-b79990d23e72 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.893143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.893883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.894201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.894554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.895467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:46.895837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.897436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.921075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 621/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:46.922381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:47.046245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed02559-1939-43b3-b339-8eabe72c7deb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:47.083258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:47.084256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:47.084787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:47.085272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:47.118569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:47.165944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:47.167744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:47.278702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 593/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:47.285000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:47.311560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:47.404033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4c6b-781c-46ec-b232-9f6f6095ea92 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:47.442760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:47.443555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:47.443882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:47.444187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:47.455654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:47.457257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:47.472026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:47.473240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:47.474159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:47.474159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:47.474159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:47:47.474159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 622/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:47:47.479177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:47.547052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:47.588722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d8fb7-e0c0-464d-b14c-abd921781e15 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:47.632125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:47.632830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:47.633041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:47.633303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:47.633935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:47.634231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:47.635601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:47.648789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 594/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:47.654548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:47.726702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:47.760244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959d782-e712-472b-96b6-1b96b399d759 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:47.793794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:47.794514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:47.794705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:47.794959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:47.801932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:47.803314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:47.815211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:47.816364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:47:47.817562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 623/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:47.824312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:47.941504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a727c0-e308-4a9d-87ce-db12f3c9056b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:47.967617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:47.979500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:47.980119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:47.980399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:47.980671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:47.981383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:47.981656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:47.983081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31cbf7-a9c8-493d-9afa-5f0295cd457c None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:47.996346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 595/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:48.002958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:48.106243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186bb40-30ff-40a7-8d92-2635db53d819 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:48.135867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:48.142777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:48.143462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:48.143760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:48.144048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:48.144966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=afb56a729d814fefaf904697e97fd33c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:48.145250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:48.146760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cad83-fe1d-45e6-9539-83ccc2180f93 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:48.152368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 624/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:47:48 2022] GET /identity/v3/role_assignments?user.id=afb56a729d814fefaf904697e97fd33c&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:50.517146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a1676-dc9b-4fcc-a3ef-3317c00313a6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.517713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a1676-dc9b-4fcc-a3ef-3317c00313a6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.517713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a1676-dc9b-4fcc-a3ef-3317c00313a6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.519026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 596/1220] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:50.527913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.527913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.527913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.545743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:50.546991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:50.628644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 625/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:47:50.917669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a1676-dc9b-4fcc-a3ef-3317c00313a6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.037875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a1676-dc9b-4fcc-a3ef-3317c00313a6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.074137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.074802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.075078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.075343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.086279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:51.091535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:51.092484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:51.093885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 597/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:47:51.099269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.212665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7f3f-04ad-4c6e-bcf1-66abfe85dc18 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.239718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:51.252942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.253553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.253870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.254141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.255025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:51.255322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:51.257088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:51.266032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 626/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:47:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:51.273008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.324112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:51.384004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89f9aa-4dd7-4eaf-bed1-b07e97484320 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.418434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.419067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.419344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.419613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.434387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:51.436210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:51.457446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:51.458571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:51.459461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:51.459461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:51.459461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:51.459461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 598/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:51.465254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.569605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452eb70-be26-4bf1-bd11-e53e8542fb1b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.603625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.604207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.604487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.604791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.605421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:51.605720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:51.607075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:51.619518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 627/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:51.625693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.731149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:51.738866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6e60-52c5-41cf-819e-985c1b6983cc None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.774180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.774816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.775163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.775436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.783553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:51.785154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:51.797122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:51.798246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:51.799218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:51.801162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 599/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:51.807139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.857009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:51.917079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042fe79-59d0-4cfd-b36e-0ead7d82589a None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.957894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.958935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.959280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.959553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.960289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:51.960662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:51.962438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:51.984942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 628/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:47:51.991631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:52.097285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f4c86-312d-4093-80e8-8c6268990bdb None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:52.132765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:52.133692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:52.134219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:52.134793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:52.148294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:52.150125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:52.166303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:52.167498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:52.168451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:52.168451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:52.168451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:52.168451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 600/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:52.174105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:52.287619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce0db0-ef3f-4042-8a4e-e8a38f8fa373 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:52.290449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:52.329739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:52.330356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:52.330674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:52.331054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:52.331844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:52.332143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:52.333905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:52.348122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 629/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:52.355712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:52.369091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:52.469737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87164022-8018-4234-9320-a5eff49f45d9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:52.508190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:52.508905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:52.509207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:52.509551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:52.517648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:52.519532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:52.532492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:52.533588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:52.534836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:52.538809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 601/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:52.539856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:52.641155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4add4b-b41f-4dbf-851d-d3b1166ec0c8 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:52.675817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:52.676570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:52.676882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:52.677191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:52.677971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:52.678371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:52.680011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1eed06-3413-4b82-b0bd-da840a6eb563 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:52.698547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 630/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:52.699772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:52.777946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:52.817022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ed247-4ee6-4276-ac26-52b8bef0f4ce None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:52.851080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52976035-e86f-4db8-b1f7-7f87e3b11c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:52.851749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976035-e86f-4db8-b1f7-7f87e3b11c70 None admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:52.852021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976035-e86f-4db8-b1f7-7f87e3b11c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:52.852286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976035-e86f-4db8-b1f7-7f87e3b11c70 None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/afb56a729d814fefaf904697e97fd33c/roles/67a7603e8924403aaef816d87a47b562` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:52.868997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52976035-e86f-4db8-b1f7-7f87e3b11c70 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=afb56a729d814fefaf904697e97fd33c, role_id=67a7603e8924403aaef816d87a47b562)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:52.870644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52976035-e86f-4db8-b1f7-7f87e3b11c70 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:52.883729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 602/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:47:52 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/afb56a729d814fefaf904697e97fd33c/roles/67a7603e8924403aaef816d87a47b562 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:47:55.064960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3c2b-9731-4343-aaae-2c639cce113b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:55.065546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3c2b-9731-4343-aaae-2c639cce113b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:55.065546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3c2b-9731-4343-aaae-2c639cce113b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:55.067041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 631/1233] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:55.072495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:55.072963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:55.073176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:55.092712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:55.093954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:55.167527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 603/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:55.483148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3c2b-9731-4343-aaae-2c639cce113b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:55.511597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:55.592537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3c2b-9731-4343-aaae-2c639cce113b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:55.627989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:55.628769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:55.629053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:55.629322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:55.641010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:55.645760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:55.646906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:47:55.647818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 632/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Sep 13 19:47:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:55.653911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:55.708507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:55.769818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba5fe8-2518-44dd-ab41-3294d1b89719 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:55.809810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:55.810517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:55.810796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:55.811060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:55.811723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] RBAC: Adding query filter params (name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:55.812045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:55.813662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:55.822032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 604/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Sep 13 19:47:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:55.828575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:55.927216 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:55.945779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06608d-b8e7-4733-a1cc-959d417870fc None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:55.984252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:55.984864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:55.985166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:55.985480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.001299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:56.003159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:56.024287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:56.025639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:56.027132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:56.027132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:56.027132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:47:56.027132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 633/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:56.031902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:56.143432 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93046a01-b402-42dc-ac0a-a87b7647ac00 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:56.154177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:56.184564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:56.185381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.185763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.186038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.186690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:56.187020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:56.188410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:56.201457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 605/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:56.207642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:56.322565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e4ca-8c10-4564-893a-5ac949d2c51b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:56.357521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:56.358272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.358544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.358838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.361911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:56.368403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:56.369931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:56.382630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:56.383642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:47:56.385965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 634/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:56.390237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:56.505297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09f7b-42d8-464d-9d6c-1dc1eaa401d0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:56.544260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:56.544903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.545163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.545426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.546150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:56.546448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:56.547874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:56.565531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 606/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:56.572126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:56.681491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b37fe5-02bd-42ad-b0ce-951a5df3c2b3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:56.717879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:56.718495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.718772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.719040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.784941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:56.794132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:56.795906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:56.904021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 635/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:47:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:56.911394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:56.941425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:57.029297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa90ab-1d66-4eeb-9945-5f76d598236e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:57.071850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:57.072719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:57.072963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:57.073281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:57.084218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:57.085689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:57.100056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:57.101225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:57.102445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:57.102445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:57.102445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:57.102445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 607/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:57.107841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:57.216197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:57.223660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93147929-3ac8-41bb-b85f-f1c0a8d9482b None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:57.262239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:57.263344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:57.263644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:57.263911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:57.264546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:57.264871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:57.266222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:57.279536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 636/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:57.286512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:57.374294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:57.400184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b801e1-4d04-498a-8b53-e3b941b3cc8e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:57.439192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:57.440028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:57.440425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:57.440840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:57.449184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:57.450978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:57.465322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:57.466458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:57.467554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:47:57.471599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 608/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:57.472798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:57.591168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6eb56-4525-4924-97f9-472ba8e6b3ee None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:57.634014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:57.634835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:57.635114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:57.635391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:57.636196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:57.636501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:57.638156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4c00c-8193-4726-a6f3-2239e8f49bfd None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:57.651605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 637/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:57.658236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:57.772688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59836-fb36-421b-9ebc-10e8c7e453e9 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:57.812132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:57.812862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:57.813284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:57.813585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:57.814313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] RBAC: Adding query filter params (role.id=67a7603e8924403aaef816d87a47b562, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=afb56a729d814fefaf904697e97fd33c) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:57.814618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:57.816063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d98eb-a6e1-41a7-9e50-3888ac73ee82 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:57.823536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 609/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:47:57 2022] GET /identity/v3/role_assignments?user.id=afb56a729d814fefaf904697e97fd33c&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=67a7603e8924403aaef816d87a47b562 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:00.320733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b394d-dcd5-42e9-a9d0-d5f3800fbeab None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:00.321394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b394d-dcd5-42e9-a9d0-d5f3800fbeab None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:00.321394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b394d-dcd5-42e9-a9d0-d5f3800fbeab None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:00.323080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 638/1247] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:48:00.329153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:00.329600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:00.329784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:00.337877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:00.351995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:00.353305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:00.435259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 610/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:00.717264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b394d-dcd5-42e9-a9d0-d5f3800fbeab None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:00.738971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:00.833130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b394d-dcd5-42e9-a9d0-d5f3800fbeab None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:00.878865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:00.879535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:00.879965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:00.880646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:00.892731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:48:00.898894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:00.900093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:00.901048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 639/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:48:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:00.908241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:01.020380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca64f7-3c01-44a3-b389-f218721fa03e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:01.051632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:01.057302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:01.057927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:01.058206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:01.058503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:01.059166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:01.059467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:01.060872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:01.069090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 611/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:48:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:48:01.075414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:01.156121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:01.181797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f63c98-796c-432f-ad1e-e9579a4302f7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:01.224497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:01.225172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:01.225494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:01.225776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:01.236691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:01.238341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:48:01.253314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:01.254761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:48:01.255869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:48:01.255869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:01.255869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:01.255869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 640/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:01.260909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:01.367674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a7b7-ac0d-4d02-b8af-5bfb087027f4 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:01.407065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:01.407543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:01.407824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:01.408091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:01.408764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:01.409062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:01.410448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:01.432356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 612/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:01.433591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:01.541649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64debc5b-58cb-43dc-8597-d7f1214d2f49 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:01.569575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:01.578063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:01.578702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:01.578983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:01.579279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:01.591751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:01.593236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:48:01.614812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:01.615878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:48:01.617244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:01.617840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 641/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:48:01.625679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:01.684291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:01.737829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7f924-1b0d-420a-b21c-15ae69a19096 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:01.775580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:01.776193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:01.776470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:01.776772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:01.777504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:01.777917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:01.779481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:01.802811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 613/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Sep 13 19:48:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:48:01.810437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:01.922104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f583879-5041-49ef-aaa6-b0cca321b6bf None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:01.958501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:01.959104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:01.959377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:01.959641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.022564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:02.043390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.044898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.179223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 642/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:48:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:48:02.186186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.300386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfca3f-32ff-40a1-99f2-120e6ddaa703 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.315490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:02.341027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.341676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.341946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.342193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.354972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.356587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:48:02.373068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:02.374666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:48:02.375595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:48:02.375595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:02.375595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:02.375595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 614/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:02.380244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.486187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:02.500670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf46871-326d-4ad3-a8ee-1788f4f287a1 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.539805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.540439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.540754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.541027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.541676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:02.541986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.543498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.555575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 643/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:02.562249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.668340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b78c33-dc48-4b58-9b16-244cc5c76154 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.704189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.704784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.705064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.705340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.712498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.714072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:48:02.725798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:02.726855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:02.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 615/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:02.733172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.833204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936615af-5ef6-4b48-a757-a9fee1e3ee29 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.866365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.867331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.867601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.867869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.868548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:02.868951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.870368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f700b6-fa22-4b03-b95f-5dfa7ebb18c0 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.882164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 644/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:02.888645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.918035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:03.007238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf265099-a1f9-4c41-9490-3055bce50be0 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:03.045833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:03.046431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:03.046704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:03.046972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:03.047765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=afb56a729d814fefaf904697e97fd33c) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:03.048068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:03.049560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28b73-970d-4f93-aba0-b9cd74588892 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:03.055016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 616/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/role_assignments?user.id=afb56a729d814fefaf904697e97fd33c&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=ff6687245616423c8a3e42542a544932 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:05.138366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef618319-ce54-4f96-8b56-26b7e1882aa5 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:05.139407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef618319-ce54-4f96-8b56-26b7e1882aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:05.139407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef618319-ce54-4f96-8b56-26b7e1882aa5 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:05.141128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 645/1261] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:05.147757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:05.148459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:05.148645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:05.176566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:05.178288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:05.251172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 617/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:05.514749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef618319-ce54-4f96-8b56-26b7e1882aa5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:05.529809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:05.627543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef618319-ce54-4f96-8b56-26b7e1882aa5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:05.663249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:05.663858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:05.664127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:05.664391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:05.674580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:48:05.679325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:05.680397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:05.681440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 646/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:48:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:05.686590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:05.705390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:05.790918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f01a1-497f-418c-b478-4a77cbc6db52 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:05.831605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:05.832567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:05.832996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:05.833413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:05.834454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:05.834871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:05.837089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:05.851066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 618/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:48:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:05.858038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:05.928453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:05.970459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373bc4-df2e-4a20-b9fb-24c0a21a1601 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:06.008231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:06.008873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:06.009246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:06.009627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:06.019489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:06.020960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:48:06.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:06.036226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:48:06.037402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:48:06.037402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:06.037402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:06.040835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 647/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:06.042865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:06.146551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:06.167835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac490-173a-44d9-8c39-0cfa997c1bcf None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:06.202673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:06.203264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:06.203530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:06.203794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:06.204418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:06.204739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:06.206102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:06.218580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 619/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:06.224714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:06.345088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a65b-1e97-43a9-a7c0-482da74ad27c None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:06.365965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:06.390443 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:06.391380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:06.391788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:06.392159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:06.402328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:06.403764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:48:06.415212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:06.416303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:06.417487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 648/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:06.423186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:06.530166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43a8b7-c594-46b9-889e-3b238b492c7f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:06.564805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:06.565416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:06.565693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:06.565961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:06.566676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:06.566982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:06.568414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:06.577734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:06.586467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 620/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Sep 13 19:48:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:06.592478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:06.695420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1d198-2925-4ad2-aad5-6d2975bedff7 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:06.729875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:06.730489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:06.730761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:06.731033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:06.742224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:06.743670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:48:06.758555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:06.759791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:48:06.760758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:48:06.760758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:06.760758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:06.760758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 649/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:48:06.768023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:06.886425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547a4c8-32ef-4196-9d37-296b236dbc00 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:06.920602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:06.921234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:06.921506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:06.921764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:06.922387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:06.922680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:06.924029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:06.935204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 621/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:06.941766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:06.983609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:07.053231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629ee2f-c878-4173-bbee-c47ad59bab4e None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:07.096267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:07.096914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:07.097184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:07.097448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:07.104185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:07.105657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:48:07.117271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:07.118322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:07.119332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 650/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:07.126795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:07.190311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:07.233765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a85b3-5794-4d20-a571-33cb2517ba8e None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:07.267769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:07.268371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:07.268652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:07.268938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:07.269623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:07.269921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:07.271352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71c91-279c-4f03-a158-23f788136e77 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:07.283172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 622/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:07.289934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:07.387087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:07.402540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a04a-2cce-40f2-9eeb-a5febeeb2391 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:07.443811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc67009-e8fb-404d-90f3-aa65b89b05df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:07.444469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc67009-e8fb-404d-90f3-aa65b89b05df None admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:07.444773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc67009-e8fb-404d-90f3-aa65b89b05df None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:07.445043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc67009-e8fb-404d-90f3-aa65b89b05df None admin] PATH_INFO: `/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/afb56a729d814fefaf904697e97fd33c/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:07.447007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc67009-e8fb-404d-90f3-aa65b89b05df None admin] RBAC: Authorizing `identity:create_grant(project_id=2a92ea0034db4d81aec7850955d18e5e, user_id=afb56a729d814fefaf904697e97fd33c, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:07.448483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc67009-e8fb-404d-90f3-aa65b89b05df None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:07.466812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 651/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Sep 13 19:48:07 2022] PUT /identity/v3/projects/2a92ea0034db4d81aec7850955d18e5e/users/afb56a729d814fefaf904697e97fd33c/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:48:09.553546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b871510-d8f3-44d3-9b9c-5d0eba32da75 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:09.554399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b871510-d8f3-44d3-9b9c-5d0eba32da75 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:09.554399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b871510-d8f3-44d3-9b9c-5d0eba32da75 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:09.556492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 623/1274] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:09.561997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:09.562411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:09.562522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:09.581840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:09.583004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:09.650751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 652/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:09.914371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b871510-d8f3-44d3-9b9c-5d0eba32da75 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:10.030832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b871510-d8f3-44d3-9b9c-5d0eba32da75 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:10.048195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:10.066746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:10.067356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:10.067628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:10.067890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:10.080463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:48:10.085255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:10.086381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:10.087448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 624/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Sep 13 19:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:10.092804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:10.176849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:10.203098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11e050-7509-41bb-8085-5882de78b76a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:10.239581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:10.240187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:10.240466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:10.240769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:10.241433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:10.242079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:10.243459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:10.251230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 653/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Sep 13 19:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:10.260358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:10.369517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169782c-0bf0-456a-b96f-7f27d69b168f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:10.401986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:10.402591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:10.402868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:10.403142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:10.412753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:10.414206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:48:10.429149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:10.430279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:48:10.431197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:48:10.431197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:10.431197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:10.431197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 625/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:10.436767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:10.554343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcb8f4-c6d6-4b1f-8841-5fdd1af24dfa None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:10.602795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:10.603736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:10.603915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:10.604140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:10.604835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:10.605135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:10.606496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:10.619131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 654/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:10.625185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:10.657010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:10.727137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1d525-0e21-4fac-9979-0fbb1f27e509 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:10.762271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:10.762887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:10.763163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:10.763426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:10.770852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:10.772285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:48:10.783470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:10.784560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:10.785693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 626/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:10.792820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:10.798870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:10.907836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7dd7-cbb8-4f8f-9edf-278f5c039b37 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:10.943413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:10.944004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:10.944284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:10.944555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:10.945312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:10.945617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:10.947043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:10.964061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 655/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Sep 13 19:48:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:10.970036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:11.067704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.079258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b94cb8-dc77-4cc4-a9e8-785c43b5f20f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:11.114641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:11.115241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:11.115516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:11.115784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:11.186174 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:11.187627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:11.278224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.295604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 627/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Sep 13 19:48:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:48:11.301929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:11.364453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.403373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36465d3-b36d-46bd-b631-54c1e23de715 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:11.437228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:11.437852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:11.438125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:11.438386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:11.448562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:11.450064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:48:11.464720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:11.465797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:48:11.466718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:48:11.466718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:48:11.466718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:11.466718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 656/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:48:11.471753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:11.593471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525a68f-0e48-4032-809b-c4fd54b7364b None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:11.630305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:11.630882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:11.631072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:11.631360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:11.631987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:11.632283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:11.633746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:11.644871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 628/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Sep 13 19:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:11.653691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:11.765464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8bdd-54a4-40df-a3d2-134df302f904 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:11.780673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.803025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:11.803641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:11.803915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:11.804184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:11.811071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:11.812514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:48:11.823760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:11.824819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: ERROR keystone.server.flask.application Sep 13 19:48:11.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 657/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Sep 13 19:48:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:11.830916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:11.891097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.944595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1103a70-a23a-4364-a875-deff5563ab3d None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:11.980324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:11.980955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:11.981228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:11.981500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:11.982183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:11.982483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:11.983914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69350f-0535-4da6-87b6-b0c695e09941 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:11.996403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 629/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Sep 13 19:48:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:12.002972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:12.119692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd37a4-976e-48f1-93d0-ca26fc880e2f None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:12.155834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:12.156360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:12.156656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:12.156928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:12.157639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] RBAC: Adding query filter params (role.id=ff6687245616423c8a3e42542a544932, scope.project.id=2a92ea0034db4d81aec7850955d18e5e, user.id=afb56a729d814fefaf904697e97fd33c) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:12.157942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:12.159357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f9301-f30b-45f1-bf3a-3a0cfca92687 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:12.165217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 658/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Sep 13 19:48:12 2022] GET /identity/v3/role_assignments?user.id=afb56a729d814fefaf904697e97fd33c&scope.project.id=2a92ea0034db4d81aec7850955d18e5e&role.id=ff6687245616423c8a3e42542a544932 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:48:14.302869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2cad7-80be-458f-991e-92d8439c2506 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:14.303486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2cad7-80be-458f-991e-92d8439c2506 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:14.303486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2cad7-80be-458f-991e-92d8439c2506 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:14.304937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 630/1288] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:14.310369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:14.310831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:14.310924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:14.330731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:14.331926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:14.364334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:14.406130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 659/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:14.679580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2cad7-80be-458f-991e-92d8439c2506 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:14.813650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2cad7-80be-458f-991e-92d8439c2506 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:14.829110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:14.861512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:14.862136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:14.862416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:14.862676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:14.863255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:14.864648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:14.874294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:14.875451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:14.876640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 631/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:48:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:14.881655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:14.990628 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1431c1e-9565-47bf-a812-6aebb99919ac None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:15.026803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:15.027422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:15.027705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:15.027971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:15.028603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:15.028937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:15.030298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0af26-2e64-4d22-8792-c85d65fa329f None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:15.035197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 660/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Sep 13 19:48:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:15.041861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:15.157995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b2937-8642-4609-be24-6025e1c67e27 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:15.195429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:15.196046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:15.196340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:15.196582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] PATH_INFO: `/v3/services` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:15.197247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:15.197545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:15.198911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae50ce-29dd-4f72-96f6-dc4f31572cfb None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:15.203668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 632/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Sep 13 19:48:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:17.325547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b2801-9770-444e-b8cf-86c5b1139226 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:17.326239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b2801-9770-444e-b8cf-86c5b1139226 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:17.326239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b2801-9770-444e-b8cf-86c5b1139226 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:17.327508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 661/1293] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:17.333168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4075-2390-472f-a9fd-bc71abd5addb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:17.333589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4075-2390-472f-a9fd-bc71abd5addb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:17.333701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f4075-2390-472f-a9fd-bc71abd5addb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:17.354307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8f3f4075-2390-472f-a9fd-bc71abd5addb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:17.355503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8f3f4075-2390-472f-a9fd-bc71abd5addb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:17.388289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:17.429070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 633/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:17.698293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b2801-9770-444e-b8cf-86c5b1139226 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:17.732751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:17.805726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b2801-9770-444e-b8cf-86c5b1139226 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:17.841758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acccc8-0bd0-4e62-ad7e-13cdec2f364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:17.842362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acccc8-0bd0-4e62-ad7e-13cdec2f364d None admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:17.842635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acccc8-0bd0-4e62-ad7e-13cdec2f364d None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:17.842908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acccc8-0bd0-4e62-ad7e-13cdec2f364d None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:17.843554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acccc8-0bd0-4e62-ad7e-13cdec2f364d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:17.844938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acccc8-0bd0-4e62-ad7e-13cdec2f364d None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:17.862422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 662/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Sep 13 19:48:17 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:48:19.987073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4492-e9a8-4107-90b7-30ab4c1d40d9 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:19.987950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4492-e9a8-4107-90b7-30ab4c1d40d9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:19.987950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c4492-e9a8-4107-90b7-30ab4c1d40d9 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:19.990123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 634/1296] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:19.998523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:19.998954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:19.999067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:20.018375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:20.019540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:20.093391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 663/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:48:20.390134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c4492-e9a8-4107-90b7-30ab4c1d40d9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:20.498639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c4492-e9a8-4107-90b7-30ab4c1d40d9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:20.536168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:20.536834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:20.537134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:20.537377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:20.537966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:20.539346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:20.548785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:20.549996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:20.550994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 635/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:48:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:20.556173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:20.574773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:20.657508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbcb17-5d93-40dd-bb73-688fb7ee0e64 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:20.710813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:20.711709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:20.712127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:20.712509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:20.713546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:20.713996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:20.715710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:20.721139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 664/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Sep 13 19:48:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:20.727960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:20.764538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:20.845999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1b3b5-5f2e-4902-a4f3-ee93b859b60f None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:20.890557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:20.891166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:20.891449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:20.891714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:20.892411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] RBAC: Adding query filter params (interface=public, service_id=5df8f6a055ce484ab1ff5dcaad91aaa2, region_id=RegionOne) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:20.892750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:20.894121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada9319-5920-465d-bfe5-74f04f86bf3e None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:20.899138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 636/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Sep 13 19:48:20 2022] GET /identity/v3/endpoints?service_id=5df8f6a055ce484ab1ff5dcaad91aaa2&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:20.905377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:20.987608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:21.007116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07850c26-8361-45af-a7ab-70b7ed4e0aa3 None admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:21.039037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495224cf-630d-486f-8ef5-19e2d449a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:21.039628 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495224cf-630d-486f-8ef5-19e2d449a555 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:21.039913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495224cf-630d-486f-8ef5-19e2d449a555 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:21.040184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495224cf-630d-486f-8ef5-19e2d449a555 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:21.040829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495224cf-630d-486f-8ef5-19e2d449a555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:21.042184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495224cf-630d-486f-8ef5-19e2d449a555 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:21.048879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 665/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Sep 13 19:48:20 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:48:23.167006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767974f2-0e4f-4ba0-a1b0-96fef77404f6 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:23.167985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767974f2-0e4f-4ba0-a1b0-96fef77404f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:23.167985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767974f2-0e4f-4ba0-a1b0-96fef77404f6 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:23.170113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 637/1302] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:48:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:23.178862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:23.179299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:23.179421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:23.206212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:23.207400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:23.277219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 666/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:23.553447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767974f2-0e4f-4ba0-a1b0-96fef77404f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:23.656761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:23.665922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767974f2-0e4f-4ba0-a1b0-96fef77404f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:23.702459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:23.703015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:23.703285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:23.703534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:23.704103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:23.705495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:23.714298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:23.715475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: ERROR keystone.server.flask.application Sep 13 19:48:23.716333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 638/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Sep 13 19:48:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:23.724066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:23.805922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:23.831403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64902e-75f5-4ae7-ae6e-75053c618e6e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:23.877272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:23.877877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:23.878158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:23.878429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] PATH_INFO: `/v3/services` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:23.879052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:23.879352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:23.880742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38137f5-557d-4dff-a94d-e01071a3aea8 None admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:23.886123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 667/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Sep 13 19:48:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:23.892159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:23.995783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f33c-0635-41f8-8fd9-95a9199dcda5 None admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:24.031367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffbad6-fb6f-424c-a9ee-f35a4831c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:24.031961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbad6-fb6f-424c-a9ee-f35a4831c217 None admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:24.032238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbad6-fb6f-424c-a9ee-f35a4831c217 None admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:24.032506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffbad6-fb6f-424c-a9ee-f35a4831c217 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:24.033197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffbad6-fb6f-424c-a9ee-f35a4831c217 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:24.034564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffbad6-fb6f-424c-a9ee-f35a4831c217 None admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:24.057039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 639/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:48:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:48:33.883004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=30 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:34.052724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:28.238768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1000e-3100-430b-ae91-3a37a460b0c9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.239406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1000e-3100-430b-ae91-3a37a460b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.239406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1000e-3100-430b-ae91-3a37a460b0c9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.244806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 668/1307] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:28.246427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702970c-8896-4934-9336-901e98763cc4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.246903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702970c-8896-4934-9336-901e98763cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.247010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702970c-8896-4934-9336-901e98763cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.325977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d702970c-8896-4934-9336-901e98763cc4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:28.327223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d702970c-8896-4934-9336-901e98763cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:28.452673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 640/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:28.746044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098761dc-cc05-486e-bacc-1aa4bc5a481a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.746301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098761dc-cc05-486e-bacc-1aa4bc5a481a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.746884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098761dc-cc05-486e-bacc-1aa4bc5a481a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.748475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 669/1309] 10.222.0.65 () {54 vars in 965 bytes} [Tue Sep 13 19:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:28.755162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e221ca-27bb-448e-acdb-2ddffe1c74f5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:28.755697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e221ca-27bb-448e-acdb-2ddffe1c74f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:28.756089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e221ca-27bb-448e-acdb-2ddffe1c74f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:28.842206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-77e221ca-27bb-448e-acdb-2ddffe1c74f5 None None] MFA Rules not processed for user `5dbd68ef35a54c45baada1c45509985c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:28.843459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77e221ca-27bb-448e-acdb-2ddffe1c74f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:28.866487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:28.925348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 641/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Tue Sep 13 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:28.934304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098761dc-cc05-486e-bacc-1aa4bc5a481a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:28.936037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-098761dc-cc05-486e-bacc-1aa4bc5a481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:29.053014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098761dc-cc05-486e-bacc-1aa4bc5a481a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:29.132154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:29.132714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:29.132988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:29.133258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:29.134852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:29.193595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:29.252284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:29.253957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c2543-cf03-4972-b9c4-567ef27ebc97 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:29.273629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 670/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:31.682967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe2a98-95ae-490d-9a63-82591858c1b8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.683821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe2a98-95ae-490d-9a63-82591858c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.683821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe2a98-95ae-490d-9a63-82591858c1b8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.686199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 642/1312] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:31.694908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103cb12-0cd6-4c59-a4dc-770750111313 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:31.695364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103cb12-0cd6-4c59-a4dc-770750111313 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:31.695364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103cb12-0cd6-4c59-a4dc-770750111313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:31.784857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b103cb12-0cd6-4c59-a4dc-770750111313 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:31.786053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b103cb12-0cd6-4c59-a4dc-770750111313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:31.883028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 671/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:32.171805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe2a98-95ae-490d-9a63-82591858c1b8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:32.173410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-74fe2a98-95ae-490d-9a63-82591858c1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.287495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe2a98-95ae-490d-9a63-82591858c1b8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:32.368331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:32.371413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:32.372078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:32.372360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:32.372650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:32.374700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:32.490856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:32.492303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5db1c8-ae3d-4f51-b5fa-51a9cbab6217 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:32.512529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 643/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:34.966617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddf3b-c239-4be9-b16b-b2dfa0127ac6 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.967189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddf3b-c239-4be9-b16b-b2dfa0127ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.967189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ddf3b-c239-4be9-b16b-b2dfa0127ac6 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:34.968515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 672/1315] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:34.973897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91839f-6444-4d17-9a7c-3d055e3f0ad1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:34.974325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91839f-6444-4d17-9a7c-3d055e3f0ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:34.974435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91839f-6444-4d17-9a7c-3d055e3f0ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.045588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7f91839f-6444-4d17-9a7c-3d055e3f0ad1 None None] MFA Rules not processed for user `f5c4cf6a8a96407ca6d6755ef729b676`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:35.046807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7f91839f-6444-4d17-9a7c-3d055e3f0ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.099399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:35.149938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 644/1316] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:35.437047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddf3b-c239-4be9-b16b-b2dfa0127ac6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:35.438667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dd2ddf3b-c239-4be9-b16b-b2dfa0127ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.451645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:35.549027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ddf3b-c239-4be9-b16b-b2dfa0127ac6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:35.632693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:35.633295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:35.633563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:35.633826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:35.635415 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:35.699001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:35.749315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:35.751944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf4676-65e0-4a09-a100-96ddaa92bdab service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:35.779900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 673/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:38.475599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946df82-b101-4059-83aa-dc9400c31f33 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.476092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946df82-b101-4059-83aa-dc9400c31f33 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.476185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946df82-b101-4059-83aa-dc9400c31f33 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.477540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 645/1318] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:38.483005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311bad7-3587-424d-8dc7-60b8feb527a1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:38.483386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311bad7-3587-424d-8dc7-60b8feb527a1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:38.483539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311bad7-3587-424d-8dc7-60b8feb527a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:38.553788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2311bad7-3587-424d-8dc7-60b8feb527a1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:38.554982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2311bad7-3587-424d-8dc7-60b8feb527a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:38.655113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 674/1319] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:38.941335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946df82-b101-4059-83aa-dc9400c31f33 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:38.943837 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0946df82-b101-4059-83aa-dc9400c31f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:39.058733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946df82-b101-4059-83aa-dc9400c31f33 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:39.148474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:39.149119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:39.149392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:39.149657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:39.151244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:39.158628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:39.261967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:39.263421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3092428-5329-4099-ae50-6949ce71dc37 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:39.281823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 646/1320] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:42.099047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250cf97-87af-4dc6-919f-db058163a9ba None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.099618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250cf97-87af-4dc6-919f-db058163a9ba None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.099618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250cf97-87af-4dc6-919f-db058163a9ba None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.101259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 675/1321] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:42.106580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517ed2-36a4-437b-8624-b8265aa4f38f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.107068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517ed2-36a4-437b-8624-b8265aa4f38f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.107355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517ed2-36a4-437b-8624-b8265aa4f38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.183069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bb517ed2-36a4-437b-8624-b8265aa4f38f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:42.184321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bb517ed2-36a4-437b-8624-b8265aa4f38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:42.250425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:42.296941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 647/1322] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:42.571702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250cf97-87af-4dc6-919f-db058163a9ba None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:42.573309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a250cf97-87af-4dc6-919f-db058163a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:42.595966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:42.686749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250cf97-87af-4dc6-919f-db058163a9ba None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:42.763852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:42.764467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:42.764772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:42.765040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:42.766638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:42.840979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:42.882105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:42.883544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7ddcb-826a-4101-ba2e-36d1464df898 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:42.902143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 676/1323] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:45.103809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4569-5de2-4aa0-a4a5-106106205e13 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:45.104373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4569-5de2-4aa0-a4a5-106106205e13 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:45.104373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a4569-5de2-4aa0-a4a5-106106205e13 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:45.105858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 648/1324] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:45.111616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474cc5-c663-47df-b837-7bd7f97238cf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:45.112061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474cc5-c663-47df-b837-7bd7f97238cf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:45.112206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f474cc5-c663-47df-b837-7bd7f97238cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:45.189715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4f474cc5-c663-47df-b837-7bd7f97238cf None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:45.190942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4f474cc5-c663-47df-b837-7bd7f97238cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.292174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 677/1325] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:45.581205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4569-5de2-4aa0-a4a5-106106205e13 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:45.582777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2d4a4569-5de2-4aa0-a4a5-106106205e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.687488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a4569-5de2-4aa0-a4a5-106106205e13 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:45.763096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:45.763701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:45.763975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:45.764239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:45.765855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:45.783019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:45.879314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:45.880794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1e8f1-9836-48ab-8514-51270e7787f6 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:45.899547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 649/1326] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:48.114062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f32aa-27e2-4c5b-9eeb-09f1f36168fe None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:48.114596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f32aa-27e2-4c5b-9eeb-09f1f36168fe None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:48.114596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f32aa-27e2-4c5b-9eeb-09f1f36168fe None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:48.115897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 678/1327] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:48.122004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc013949-b3f3-4389-9210-6ae354c0c14f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:48.122483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc013949-b3f3-4389-9210-6ae354c0c14f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:48.122642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc013949-b3f3-4389-9210-6ae354c0c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:48.191713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dc013949-b3f3-4389-9210-6ae354c0c14f None None] MFA Rules not processed for user `f5c4cf6a8a96407ca6d6755ef729b676`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:48.192938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dc013949-b3f3-4389-9210-6ae354c0c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:48.270870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:48.306386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 650/1328] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:48.587853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f32aa-27e2-4c5b-9eeb-09f1f36168fe None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:48.589463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6f6f32aa-27e2-4c5b-9eeb-09f1f36168fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:48.623411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:48.704105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f32aa-27e2-4c5b-9eeb-09f1f36168fe None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:48.780800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:48.781410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:48.781684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:48.781923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:48.783559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:48.861542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:48.895505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:48.896876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80cd364-5156-4ba8-b7b8-ccb8c26991e7 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:48.915530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 679/1329] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:51.273616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67045-1f84-4aad-9665-971de2a76d99 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.274495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67045-1f84-4aad-9665-971de2a76d99 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.274495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67045-1f84-4aad-9665-971de2a76d99 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.276540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 651/1330] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:51.282133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def23571-2274-41ea-a3bb-44f14ea5d982 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.282606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def23571-2274-41ea-a3bb-44f14ea5d982 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.282710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def23571-2274-41ea-a3bb-44f14ea5d982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.350618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-def23571-2274-41ea-a3bb-44f14ea5d982 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:51.351841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-def23571-2274-41ea-a3bb-44f14ea5d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.468592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 680/1331] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:51.761488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67045-1f84-4aad-9665-971de2a76d99 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:51.763695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-35f67045-1f84-4aad-9665-971de2a76d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.872239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67045-1f84-4aad-9665-971de2a76d99 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:51.949482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:51.950074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:51.950375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:51.950640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:51.952208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:51.978944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:52.080501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:52.081887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b7ad8-9905-4cf4-80cd-93a66fe97feb service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:52.101112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 652/1332] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:49:54.263134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c378-ea48-4e33-97c8-0ba3e43c2f8a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:54.263733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c378-ea48-4e33-97c8-0ba3e43c2f8a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:54.263733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c378-ea48-4e33-97c8-0ba3e43c2f8a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:54.265882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 681/1333] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:54.274099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93dc5-bab3-4545-b673-1f019c0fa263 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:54.274584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93dc5-bab3-4545-b673-1f019c0fa263 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:54.274584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93dc5-bab3-4545-b673-1f019c0fa263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:54.350094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-41e93dc5-bab3-4545-b673-1f019c0fa263 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:54.351312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-41e93dc5-bab3-4545-b673-1f019c0fa263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:54.429532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:54.452457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 653/1334] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:49:54.740744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c378-ea48-4e33-97c8-0ba3e43c2f8a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:54.742288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5d62c378-ea48-4e33-97c8-0ba3e43c2f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:54.785345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:54.865635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c378-ea48-4e33-97c8-0ba3e43c2f8a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:54.951212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:54.951821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:54.952104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:54.952375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:54.954040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:55.044356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:55.073002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:55.074440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6f07e-02f1-4cb9-82ea-9248adb044f6 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:55.093316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 682/1335] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:49:57.587038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb8f7f-1a61-42ca-942f-78c0cf9c32bf None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.587897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb8f7f-1a61-42ca-942f-78c0cf9c32bf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.587897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb8f7f-1a61-42ca-942f-78c0cf9c32bf None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.589946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 654/1336] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:49:57.595503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d6e1-af60-47e1-8d32-892615f59bd8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:57.595980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d6e1-af60-47e1-8d32-892615f59bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:57.596075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247d6e1-af60-47e1-8d32-892615f59bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:57.663162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a247d6e1-af60-47e1-8d32-892615f59bd8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:49:57.664358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a247d6e1-af60-47e1-8d32-892615f59bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:57.766914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 683/1337] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:49:58.057437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb8f7f-1a61-42ca-942f-78c0cf9c32bf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:49:58.059988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b7cb8f7f-1a61-42ca-942f-78c0cf9c32bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.181638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb8f7f-1a61-42ca-942f-78c0cf9c32bf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:49:58.268254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:49:58.268896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:49:58.269175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:49:58.269440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:49:58.271039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:49:58.309258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:58.389112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:49:58.390553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94339e84-e4b3-4150-8646-bac8e64c68ee service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:49:58.409406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 655/1338] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:49:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:02.499709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c25e4-777b-4a28-b2c8-bb7f8e2a566c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.500318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c25e4-777b-4a28-b2c8-bb7f8e2a566c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.500318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c25e4-777b-4a28-b2c8-bb7f8e2a566c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.502755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 684/1339] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:02.509857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9e6c-3a94-46d0-9915-98eaad6783f5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.510403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9e6c-3a94-46d0-9915-98eaad6783f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.510403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9e6c-3a94-46d0-9915-98eaad6783f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.585724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e85c9e6c-3a94-46d0-9915-98eaad6783f5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:02.586875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e85c9e6c-3a94-46d0-9915-98eaad6783f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:02.676692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:02.688411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 656/1340] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:02.983032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768e17-d1ac-46f1-a1b5-cadc5a9f8588 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.983313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768e17-d1ac-46f1-a1b5-cadc5a9f8588 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.983581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f768e17-d1ac-46f1-a1b5-cadc5a9f8588 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:02.985025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 685/1341] 10.222.0.65 () {54 vars in 965 bytes} [Tue Sep 13 19:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:02.991424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235f7d0-6c38-40db-b541-8f25d86c0a7c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:02.991708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235f7d0-6c38-40db-b541-8f25d86c0a7c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:02.991975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235f7d0-6c38-40db-b541-8f25d86c0a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.072482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5235f7d0-6c38-40db-b541-8f25d86c0a7c None None] MFA Rules not processed for user `5dbd68ef35a54c45baada1c45509985c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:03.073725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5235f7d0-6c38-40db-b541-8f25d86c0a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.153066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 657/1342] 10.222.0.65 () {58 vars in 1062 bytes} [Tue Sep 13 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:03.162245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f768e17-d1ac-46f1-a1b5-cadc5a9f8588 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:03.163820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3f768e17-d1ac-46f1-a1b5-cadc5a9f8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.219863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:03.277059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f768e17-d1ac-46f1-a1b5-cadc5a9f8588 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:03.354805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:03.355430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:03.355704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:03.355968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:03.357607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:03.457421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:03.477688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:03.479238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6612a-c458-4320-8c25-7b740dad1938 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:03.502052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 686/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:06.814528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0078-9337-497b-ba88-e6a836d5f86b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.815063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0078-9337-497b-ba88-e6a836d5f86b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.815063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0078-9337-497b-ba88-e6a836d5f86b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.816327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 658/1344] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:06.821860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c878-9495-4c02-9c81-2326a778f414 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:06.822310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c878-9495-4c02-9c81-2326a778f414 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:06.822403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c878-9495-4c02-9c81-2326a778f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:06.896260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-96d1c878-9495-4c02-9c81-2326a778f414 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:06.897551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-96d1c878-9495-4c02-9c81-2326a778f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:07.007154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 687/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:07.291025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0078-9337-497b-ba88-e6a836d5f86b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:07.292584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3ad0078-9337-497b-ba88-e6a836d5f86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:07.388235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:07.406555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0078-9337-497b-ba88-e6a836d5f86b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:07.488654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:07.489388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:07.489661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:07.489925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:07.491525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:07.606414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:07.607965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48349f-82db-427d-b08b-2f0b7864a647 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:07.632062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 659/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:12.028301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78c1f-6838-44f8-8642-d1665fd64edf None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.028848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78c1f-6838-44f8-8642-d1665fd64edf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.028943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b78c1f-6838-44f8-8642-d1665fd64edf None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.030378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 688/1347] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:12.036896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95add3d8-2dc3-42ba-abd4-ef029104f446 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.037675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95add3d8-2dc3-42ba-abd4-ef029104f446 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.037675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95add3d8-2dc3-42ba-abd4-ef029104f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.059205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:12.115548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-95add3d8-2dc3-42ba-abd4-ef029104f446 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:12.116892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-95add3d8-2dc3-42ba-abd4-ef029104f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:12.213875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 660/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:12.495703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78c1f-6838-44f8-8642-d1665fd64edf None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:12.497330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-91b78c1f-6838-44f8-8642-d1665fd64edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:12.556586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:12.606521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b78c1f-6838-44f8-8642-d1665fd64edf None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:12.681074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:12.681685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:12.681955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:12.682225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:12.683825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:12.797166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:12.803330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:12.804772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052f4b4-9cdc-4e6a-818e-fcfafcc7bde1 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:12.824912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 689/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:17.766896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634680-f2dd-4f9a-90a6-58a077012df8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:17.767722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634680-f2dd-4f9a-90a6-58a077012df8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:17.768144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8634680-f2dd-4f9a-90a6-58a077012df8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:17.769907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 661/1350] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:17.776487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b382-8f31-424a-b04b-02ad0d3e76ba None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:17.776940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b382-8f31-424a-b04b-02ad0d3e76ba None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:17.777049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b382-8f31-424a-b04b-02ad0d3e76ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:17.901956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-77b4b382-8f31-424a-b04b-02ad0d3e76ba None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:17.903437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-77b4b382-8f31-424a-b04b-02ad0d3e76ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:18.046909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 690/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:50:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:22.130274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f588c-a17e-4ce6-b8e0-b47bd9d731f7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.130855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f588c-a17e-4ce6-b8e0-b47bd9d731f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.130855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f588c-a17e-4ce6-b8e0-b47bd9d731f7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.132383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 662/1352] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:22.137397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345711f2-5ca2-4327-abdc-483a66b0f14a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:22.138134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345711f2-5ca2-4327-abdc-483a66b0f14a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:22.138557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345711f2-5ca2-4327-abdc-483a66b0f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:22.201255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:22.212148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=59 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:22.229032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-345711f2-5ca2-4327-abdc-483a66b0f14a None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:22.230600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-345711f2-5ca2-4327-abdc-483a66b0f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:22.349164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 691/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:50:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:23.796175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20454275-875d-451c-aa0c-780769c3e194 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.796791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20454275-875d-451c-aa0c-780769c3e194 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.796791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20454275-875d-451c-aa0c-780769c3e194 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.798293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 663/1354] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:23.803802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3a81-a329-4d50-a752-6f6b195c5027 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:23.804249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3a81-a329-4d50-a752-6f6b195c5027 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:23.804332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec3a81-a329-4d50-a752-6f6b195c5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:23.886257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-adec3a81-a329-4d50-a752-6f6b195c5027 None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:23.887481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-adec3a81-a329-4d50-a752-6f6b195c5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:23.931946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:24.001887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 692/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:50:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:27.494007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed46964-2199-40f3-9f23-d15010a7913c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.494583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed46964-2199-40f3-9f23-d15010a7913c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.494784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed46964-2199-40f3-9f23-d15010a7913c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.496989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 664/1356] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:27.502296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccbdb6-0b10-46e9-bbf9-4065053e0418 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.503102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccbdb6-0b10-46e9-bbf9-4065053e0418 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.503380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccbdb6-0b10-46e9-bbf9-4065053e0418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.573083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-02ccbdb6-0b10-46e9-bbf9-4065053e0418 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:27.574164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-02ccbdb6-0b10-46e9-bbf9-4065053e0418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:27.689394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 693/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:27.989183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4bd7-669c-4cdd-8ed7-532a29ec30bc None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:27.989629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4bd7-669c-4cdd-8ed7-532a29ec30bc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:27.990003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4bd7-669c-4cdd-8ed7-532a29ec30bc None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:27.991599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 665/1358] 10.222.0.65 () {54 vars in 962 bytes} [Tue Sep 13 19:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:28.003804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bbe5c-b163-45ba-941c-7656eb3b2e93 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:28.004360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bbe5c-b163-45ba-941c-7656eb3b2e93 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:28.004988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bbe5c-b163-45ba-941c-7656eb3b2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:28.028323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:28.233823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f96bbe5c-b163-45ba-941c-7656eb3b2e93 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:28.235859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f96bbe5c-b163-45ba-941c-7656eb3b2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.376039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 694/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Sep 13 19:50:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:28.384605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f4bd7-669c-4cdd-8ed7-532a29ec30bc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:28.386301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e57f4bd7-669c-4cdd-8ed7-532a29ec30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.549945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f4bd7-669c-4cdd-8ed7-532a29ec30bc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:28.633200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:28.675094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:28.675706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:28.675983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:28.676260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:28.677864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:28.769722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:28.771332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a1ea9-579d-4bf2-bd0c-7d1c2b981cba service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:28.790146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 666/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:31.163468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf7da-7254-4150-8190-55ea75006c4d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.164067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf7da-7254-4150-8190-55ea75006c4d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.164067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccf7da-7254-4150-8190-55ea75006c4d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.165387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 695/1361] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:31.170800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5f6c-2620-475d-89d0-227484c42ca6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.171273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5f6c-2620-475d-89d0-227484c42ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.171395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a5f6c-2620-475d-89d0-227484c42ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.241899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9c3a5f6c-2620-475d-89d0-227484c42ca6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:31.243120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9c3a5f6c-2620-475d-89d0-227484c42ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.282501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:31.348702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 667/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:31.642331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf7da-7254-4150-8190-55ea75006c4d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:31.643978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d5ccf7da-7254-4150-8190-55ea75006c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.716429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:31.802817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccf7da-7254-4150-8190-55ea75006c4d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:31.914434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:31.915047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:31.915317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:31.915580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:31.917202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:31.941651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:32.014460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:32.016019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ba893-7d1f-484f-b9f8-df3c5a668c18 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:32.035086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 696/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:34.483782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63106f-74e5-4218-9913-7dd24903f22b None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.484828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63106f-74e5-4218-9913-7dd24903f22b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.485331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63106f-74e5-4218-9913-7dd24903f22b None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.487128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 668/1364] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:34.492645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3a5f-9d53-4834-a945-364270464301 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.493124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3a5f-9d53-4834-a945-364270464301 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.493212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3a5f-9d53-4834-a945-364270464301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.562972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3e2f3a5f-9d53-4834-a945-364270464301 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:34.564178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3e2f3a5f-9d53-4834-a945-364270464301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:34.664995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:34.676331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 697/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:34.953768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81da1-8cfe-4bcc-a0a7-bc58484bc163 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.954290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81da1-8cfe-4bcc-a0a7-bc58484bc163 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.954769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d81da1-8cfe-4bcc-a0a7-bc58484bc163 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:34.956563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 669/1366] 10.222.0.65 () {54 vars in 962 bytes} [Tue Sep 13 19:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:34.961966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305211-91c5-414f-8488-47d7eb0f36fb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:34.962327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305211-91c5-414f-8488-47d7eb0f36fb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:34.962675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305211-91c5-414f-8488-47d7eb0f36fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.043991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c3305211-91c5-414f-8488-47d7eb0f36fb None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:35.045344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c3305211-91c5-414f-8488-47d7eb0f36fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:35.168555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 698/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Sep 13 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:35.176450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d81da1-8cfe-4bcc-a0a7-bc58484bc163 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:35.178042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e1d81da1-8cfe-4bcc-a0a7-bc58484bc163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:35.337672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d81da1-8cfe-4bcc-a0a7-bc58484bc163 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:35.358600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:35.473880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:35.474498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:35.474782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:35.475035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.476675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:35.549488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119bb9-0171-4791-b161-69cea4d79f02 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:35.550034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119bb9-0171-4791-b161-69cea4d79f02 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:35.550034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64119bb9-0171-4791-b161-69cea4d79f02 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.551736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 699/1368] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:50:35.556467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cf24-6aa7-4d82-962b-430247dd411d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:35.556791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cf24-6aa7-4d82-962b-430247dd411d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:35.557210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cf24-6aa7-4d82-962b-430247dd411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:35.580269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:35.582109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb75f2a-3770-4cc8-a20e-6ab8ccd2d0ef service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:35.601297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 670/1369] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:35.622673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:35.631643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1648cf24-6aa7-4d82-962b-430247dd411d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:35.633497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1648cf24-6aa7-4d82-962b-430247dd411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:35.770159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 700/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:36.100294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8d8f-7176-4ce8-bae9-d416ea4e716f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:36.100528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8d8f-7176-4ce8-bae9-d416ea4e716f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:36.100880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8d8f-7176-4ce8-bae9-d416ea4e716f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:36.102403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 671/1371] 10.222.0.65 () {54 vars in 964 bytes} [Tue Sep 13 19:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:36.107601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c625-ac2f-48ec-8504-bbfbb9516c6c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:36.107873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c625-ac2f-48ec-8504-bbfbb9516c6c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:36.108151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c625-ac2f-48ec-8504-bbfbb9516c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:36.194933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0031c625-ac2f-48ec-8504-bbfbb9516c6c None None] MFA Rules not processed for user `d81e355fe7294414a24428411ade0019`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:36.196154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0031c625-ac2f-48ec-8504-bbfbb9516c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:36.268578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:36.282076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 701/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Tue Sep 13 19:50:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:36.285446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8d8f-7176-4ce8-bae9-d416ea4e716f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:36.286955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5efa8d8f-7176-4ce8-bae9-d416ea4e716f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:36.315530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:36.404324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8d8f-7176-4ce8-bae9-d416ea4e716f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:36.503038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:36.503813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:36.504188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:36.504556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:36.506573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:36.615587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:36.666406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:36.668484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13130fa0-94d9-4681-be32-024214a12a04 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:36.697062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 672/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:37.834745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562c3e-acbb-48de-8775-00de7b342ce9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.835353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562c3e-acbb-48de-8775-00de7b342ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.835353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562c3e-acbb-48de-8775-00de7b342ce9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.836653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 702/1374] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:37.842223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d2c3-dd97-4704-bf65-d02c60999f65 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:37.842648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d2c3-dd97-4704-bf65-d02c60999f65 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:37.842755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4d2c3-dd97-4704-bf65-d02c60999f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:37.919593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f8d4d2c3-dd97-4704-bf65-d02c60999f65 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:37.920891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f8d4d2c3-dd97-4704-bf65-d02c60999f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:38.022447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 673/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:38.315144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562c3e-acbb-48de-8775-00de7b342ce9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:38.316748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb562c3e-acbb-48de-8775-00de7b342ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:38.467150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562c3e-acbb-48de-8775-00de7b342ce9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:38.546251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:38.598074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:38.598687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:38.598965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:38.599230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:38.600879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:38.697198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:38.698758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b896eb-ec0f-483b-9e57-46d2e65618c2 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:38.717570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 703/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:40.931918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dacb-f54e-48ad-a2f8-f8e050028b61 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.932540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dacb-f54e-48ad-a2f8-f8e050028b61 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.932540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dacb-f54e-48ad-a2f8-f8e050028b61 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:40.933996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 674/1377] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:40.939605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783eb8a-eb83-4ae3-b2de-8b7e7c85c2a9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:40.940544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783eb8a-eb83-4ae3-b2de-8b7e7c85c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:40.940856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783eb8a-eb83-4ae3-b2de-8b7e7c85c2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.017883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2783eb8a-eb83-4ae3-b2de-8b7e7c85c2a9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:41.020015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2783eb8a-eb83-4ae3-b2de-8b7e7c85c2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:41.052465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:41.125036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 704/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:41.431727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76dacb-f54e-48ad-a2f8-f8e050028b61 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:41.433424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-de76dacb-f54e-48ad-a2f8-f8e050028b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:41.472246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:41.592408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76dacb-f54e-48ad-a2f8-f8e050028b61 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:41.710628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:41.715945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:41.716811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:41.717257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:41.717669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:41.720270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:41.820572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:41.822367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d307e5-de3f-42ad-a50f-d001184facb9 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:41.842210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 675/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:44.048668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b900-04e4-4792-bd41-41a2689350eb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.049338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b900-04e4-4792-bd41-41a2689350eb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.049338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555b900-04e4-4792-bd41-41a2689350eb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.050655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 705/1380] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:44.056775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bde8e8-0ae5-4945-8348-08d7d62d1ba9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.057338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bde8e8-0ae5-4945-8348-08d7d62d1ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.057338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bde8e8-0ae5-4945-8348-08d7d62d1ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.154445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a0bde8e8-0ae5-4945-8348-08d7d62d1ba9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:44.155701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a0bde8e8-0ae5-4945-8348-08d7d62d1ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:44.222133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:44.255813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 676/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:44.546511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b900-04e4-4792-bd41-41a2689350eb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:44.548115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7555b900-04e4-4792-bd41-41a2689350eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:44.706891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555b900-04e4-4792-bd41-41a2689350eb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:44.722581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:44.830460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:44.831106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:44.831393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:44.831660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:44.833418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:44.933000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:44.934739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976f48d-9e58-44f3-8f23-275a07015b27 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:44.955110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 706/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:47.366716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4edc-84d9-482f-8347-9428302569f0 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:47.367426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4edc-84d9-482f-8347-9428302569f0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:47.367426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d4edc-84d9-482f-8347-9428302569f0 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:47.368989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 677/1383] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:47.376286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a83a25-4d53-4076-a2f1-0635d7a2d244 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:47.376806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a83a25-4d53-4076-a2f1-0635d7a2d244 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:47.376917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a83a25-4d53-4076-a2f1-0635d7a2d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:47.409272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:47.470330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-68a83a25-4d53-4076-a2f1-0635d7a2d244 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:47.471933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-68a83a25-4d53-4076-a2f1-0635d7a2d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:47.591922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 707/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:47.893751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4edc-84d9-482f-8347-9428302569f0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:47.895237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd5d4edc-84d9-482f-8347-9428302569f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:48.088669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d4edc-84d9-482f-8347-9428302569f0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:48.159774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:48.229919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:48.230607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:48.230857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:48.231136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:48.232922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:48.330216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:48.332996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a346-c259-4798-8e45-2e62a473f499 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:48.364841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 678/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:50:50.947065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adf741-34ac-4475-9ef5-adc0a17c73d6 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:50.947673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adf741-34ac-4475-9ef5-adc0a17c73d6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:50.947673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adf741-34ac-4475-9ef5-adc0a17c73d6 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:50.949210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 708/1386] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:50.954721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc85c-fa4c-4176-a4e1-df34e86e51ed None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:50.955198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc85c-fa4c-4176-a4e1-df34e86e51ed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:50.955312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdc85c-fa4c-4176-a4e1-df34e86e51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.023409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5cbdc85c-fa4c-4176-a4e1-df34e86e51ed None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:51.024630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5cbdc85c-fa4c-4176-a4e1-df34e86e51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:51.032932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:51.124261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 679/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:51.416993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adf741-34ac-4475-9ef5-adc0a17c73d6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:51.418547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a4adf741-34ac-4475-9ef5-adc0a17c73d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:51.517298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:51.571560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adf741-34ac-4475-9ef5-adc0a17c73d6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:51.689620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:51.690115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:51.690420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:51.690692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.692289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:51.762658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:51.796403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:51.798068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2c1b1-ff90-4db2-a598-648c24462f0d service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:51.817077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 709/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:51.823762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170326-1258-4f56-86f0-009816487e15 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:51.824113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170326-1258-4f56-86f0-009816487e15 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:51.824577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2170326-1258-4f56-86f0-009816487e15 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.825959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 680/1389] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:51.831296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb645-fbfe-487d-8f84-22a5db80ef62 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:51.831723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb645-fbfe-487d-8f84-22a5db80ef62 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:51.831958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb645-fbfe-487d-8f84-22a5db80ef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:51.901502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cbabb645-fbfe-487d-8f84-22a5db80ef62 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:51.902763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cbabb645-fbfe-487d-8f84-22a5db80ef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.011761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 710/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:52.314001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c1e4b-86ce-4bfe-8985-592775652257 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.314461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c1e4b-86ce-4bfe-8985-592775652257 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.314555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c1e4b-86ce-4bfe-8985-592775652257 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.315904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 681/1391] 10.222.0.65 () {54 vars in 966 bytes} [Tue Sep 13 19:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:52.321479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78064a-ae21-4ac7-9e74-bd93b30e7118 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.321748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78064a-ae21-4ac7-9e74-bd93b30e7118 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.322040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78064a-ae21-4ac7-9e74-bd93b30e7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.369244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:52.401957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7b78064a-ae21-4ac7-9e74-bd93b30e7118 None None] MFA Rules not processed for user `ebe21ca5e9924e458c2d37c28e7ee1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:52.403170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7b78064a-ae21-4ac7-9e74-bd93b30e7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.489824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 711/1392] 10.222.0.65 () {58 vars in 1063 bytes} [Tue Sep 13 19:50:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:52.499756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c1e4b-86ce-4bfe-8985-592775652257 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:52.501329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b83c1e4b-86ce-4bfe-8985-592775652257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.609170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c1e4b-86ce-4bfe-8985-592775652257 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:52.648761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:52.684748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:52.685359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:52.685633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:52.685900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:52.687470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:52.807900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:52.809390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4a8b5-6ad9-4bf4-a0a2-1a546d450638 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:52.829252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 682/1393] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:53.598483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b66a0a-8c8b-4708-b4ad-4d6c624a7dd4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:53.599043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b66a0a-8c8b-4708-b4ad-4d6c624a7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:53.599043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b66a0a-8c8b-4708-b4ad-4d6c624a7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:53.667401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-43b66a0a-8c8b-4708-b4ad-4d6c624a7dd4 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:53.668595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-43b66a0a-8c8b-4708-b4ad-4d6c624a7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:53.749312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.757344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 712/1394] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 19:50:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:53.805311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1828efc-d279-48fc-aa91-ddc96c246ca7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:53.805847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1828efc-d279-48fc-aa91-ddc96c246ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:53.805847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1828efc-d279-48fc-aa91-ddc96c246ca7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:53.807168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 683/1395] 10.222.0.65 () {54 vars in 943 bytes} [Tue Sep 13 19:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:53.813470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:53.813758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:53.814052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:53.892205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] MFA Rules not processed for user `060c831449d541a28a826628ac472ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:53.893493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.009796 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 713/1396] 10.222.0.65 () {58 vars in 1040 bytes} [Tue Sep 13 19:50:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:50:54.015855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd144c85-ecff-495c-b0d4-adb98752bc8a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.016328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd144c85-ecff-495c-b0d4-adb98752bc8a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.016665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd144c85-ecff-495c-b0d4-adb98752bc8a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.018433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 684/1397] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:54.019040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.023680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.023963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.024243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.029100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f584b-e222-4453-88d1-5722750e6256 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.079399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.090517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:54.091861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.110582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.137079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.137744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.138019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.138285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.139910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.191031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 685/1398] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:54.223250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.224951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453784d4-fb8f-46e8-a233-bfae8b4cf5d9 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.232905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 714/1399] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 19:50:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 19:50:54.475391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:54.476695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.608410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274cdbc-4f60-43ae-ab63-b217bf970587 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:54.647356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.732296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:54.732947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:54.733228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:54.733487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:54.735087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:54.833474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:54.835110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313235b-e68c-41d7-a31d-30092c69f77d service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:54.857051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 686/1400] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:50:57.073969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f262a2-f1d8-4929-83cd-af9c24578d26 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.074603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f262a2-f1d8-4929-83cd-af9c24578d26 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.074603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f262a2-f1d8-4929-83cd-af9c24578d26 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.075937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 715/1401] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:50:57.081224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a13a-8e92-4ed6-acde-dc877cef015b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.081680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a13a-8e92-4ed6-acde-dc877cef015b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.081781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a13a-8e92-4ed6-acde-dc877cef015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.132653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:57.152030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5876a13a-8e92-4ed6-acde-dc877cef015b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:50:57.153392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5876a13a-8e92-4ed6-acde-dc877cef015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:57.265273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 687/1402] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:50:57.550681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f262a2-f1d8-4929-83cd-af9c24578d26 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:50:57.552293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-47f262a2-f1d8-4929-83cd-af9c24578d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:57.637898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:57.708494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f262a2-f1d8-4929-83cd-af9c24578d26 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:50:57.827609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:50:57.828250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:50:57.828526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:50:57.828823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:50:57.830438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:50:57.879474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:57.947309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:50:57.948983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d8353-54bf-4aa5-b164-8fed0336a589 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:50:57.974797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 716/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:00.207868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d30eb-9a9b-44c8-aa7c-760c5337f518 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:00.208565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d30eb-9a9b-44c8-aa7c-760c5337f518 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:00.208565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d30eb-9a9b-44c8-aa7c-760c5337f518 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:00.212978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 688/1404] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:51:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:00.215589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545d173-3b20-40f7-b6c6-21ac1b48705e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:00.216057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545d173-3b20-40f7-b6c6-21ac1b48705e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:00.216149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545d173-3b20-40f7-b6c6-21ac1b48705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:00.321450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5545d173-3b20-40f7-b6c6-21ac1b48705e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:00.322863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5545d173-3b20-40f7-b6c6-21ac1b48705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:00.430608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 717/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:00.715138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d30eb-9a9b-44c8-aa7c-760c5337f518 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:00.716801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7f2d30eb-9a9b-44c8-aa7c-760c5337f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:00.839480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:00.873581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d30eb-9a9b-44c8-aa7c-760c5337f518 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:01.000301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:01.000980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:01.001262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:01.001530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:01.003176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:01.089596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:01.101157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:01.102780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ca6b3-7780-40e9-b91e-3a619a58fce8 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:01.122750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 689/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:03.302791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd300-47cc-4549-89ac-fe6f0d8cc925 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:03.303372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd300-47cc-4549-89ac-fe6f0d8cc925 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:03.303372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0cd300-47cc-4549-89ac-fe6f0d8cc925 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:03.304961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 718/1407] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:03.310250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c192-fcd3-4863-99c5-e74027ffbd8e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:03.311554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c192-fcd3-4863-99c5-e74027ffbd8e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:03.315325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c192-fcd3-4863-99c5-e74027ffbd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:03.402598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0673c192-fcd3-4863-99c5-e74027ffbd8e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:03.404305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0673c192-fcd3-4863-99c5-e74027ffbd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:03.516768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 690/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:03.810269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cd300-47cc-4549-89ac-fe6f0d8cc925 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:03.811845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bc0cd300-47cc-4549-89ac-fe6f0d8cc925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:03.831932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:03.969119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0cd300-47cc-4549-89ac-fe6f0d8cc925 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:04.073724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:04.098562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:04.099169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:04.099442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:04.099820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:04.101478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:04.195940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:04.197609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca111705-c170-4fbb-bb72-f6af5698bafa service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:04.216523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 719/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:13.514859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=74 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:14.214113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=54 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:17.136773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e4a55-dfae-4c38-9bc0-71adfd96238e None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:17.137375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e4a55-dfae-4c38-9bc0-71adfd96238e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:17.137375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e4a55-dfae-4c38-9bc0-71adfd96238e None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:17.138704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 691/1410] 10.222.0.65 () {54 vars in 918 bytes} [Tue Sep 13 19:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:17.143991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1d3f-d044-48ce-b9c3-b62e21834884 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:17.144481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1d3f-d044-48ce-b9c3-b62e21834884 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:17.144584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1d3f-d044-48ce-b9c3-b62e21834884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:17.227781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-da4c1d3f-d044-48ce-b9c3-b62e21834884 None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:17.229040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-da4c1d3f-d044-48ce-b9c3-b62e21834884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:17.349411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 720/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Sep 13 19:51:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:17.366435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5baa9-dad9-41b7-8939-19f0c4967f6c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:17.366714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5baa9-dad9-41b7-8939-19f0c4967f6c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:17.366977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5baa9-dad9-41b7-8939-19f0c4967f6c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:17.368311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 692/1412] 10.222.0.65 () {54 vars in 918 bytes} [Tue Sep 13 19:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:17.373662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623be56-941c-4e72-89e1-a2beb4dfb708 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:17.373939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623be56-941c-4e72-89e1-a2beb4dfb708 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:17.374212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623be56-941c-4e72-89e1-a2beb4dfb708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:17.448945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:17.451867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5623be56-941c-4e72-89e1-a2beb4dfb708 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:17.453835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5623be56-941c-4e72-89e1-a2beb4dfb708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:17.575946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 721/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Sep 13 19:51:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:20.223476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b8ab8-c816-41d7-b4ba-3b97161840a8 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:20.224046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b8ab8-c816-41d7-b4ba-3b97161840a8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:20.224046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b8ab8-c816-41d7-b4ba-3b97161840a8 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:20.226133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:20.231619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd9db-6939-4438-8b11-b7a52bdf10ac None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:20.232082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd9db-6939-4438-8b11-b7a52bdf10ac None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:20.232192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdd9db-6939-4438-8b11-b7a52bdf10ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:20.306617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-86fdd9db-6939-4438-8b11-b7a52bdf10ac None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:20.307866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-86fdd9db-6939-4438-8b11-b7a52bdf10ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:20.372259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:20.417794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:20.719795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b8ab8-c816-41d7-b4ba-3b97161840a8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:20.721630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6d4b8ab8-c816-41d7-b4ba-3b97161840a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:20.870243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b8ab8-c816-41d7-b4ba-3b97161840a8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:20.953384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:20.997910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:20.998769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:20.999127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:20.999400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:21.001335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:21.106749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:21.108361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa0bd9-ddc4-4166-9be6-c1f008829f8c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:21.126923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 694/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:22.274001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32cb3d-dab3-438a-b26c-bf6accf774bb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:22.274894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32cb3d-dab3-438a-b26c-bf6accf774bb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:22.274894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32cb3d-dab3-438a-b26c-bf6accf774bb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:22.276977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:22.283541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547854-e3a3-4132-a755-3cfa3b611d30 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:22.284024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547854-e3a3-4132-a755-3cfa3b611d30 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:22.284024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547854-e3a3-4132-a755-3cfa3b611d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:22.369514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1f547854-e3a3-4132-a755-3cfa3b611d30 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:22.371132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1f547854-e3a3-4132-a755-3cfa3b611d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:22.399464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:22.474109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:22.623384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32cb3d-dab3-438a-b26c-bf6accf774bb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:22.625835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bb32cb3d-dab3-438a-b26c-bf6accf774bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:22.789708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb32cb3d-dab3-438a-b26c-bf6accf774bb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:22.841956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:22.920742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:22.921297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:22.921576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:22.921848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:22.923460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:23.015559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:23.017212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7fc3e-b6d2-41b1-a23d-43eaa04f50c5 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:23.036691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 724/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:24.169693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b478d08-8528-44b3-ae9c-547119035c73 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:24.170294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b478d08-8528-44b3-ae9c-547119035c73 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:24.170294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b478d08-8528-44b3-ae9c-547119035c73 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:24.172285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:24.182580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c35a5f-e891-4fc5-a0cc-ee829bec4ee5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:24.183095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c35a5f-e891-4fc5-a0cc-ee829bec4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:24.183256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c35a5f-e891-4fc5-a0cc-ee829bec4ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:24.241597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:24.266007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-20c35a5f-e891-4fc5-a0cc-ee829bec4ee5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:24.267236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-20c35a5f-e891-4fc5-a0cc-ee829bec4ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:24.378102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:24.534959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b478d08-8528-44b3-ae9c-547119035c73 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:24.537697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b478d08-8528-44b3-ae9c-547119035c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:24.697955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b478d08-8528-44b3-ae9c-547119035c73 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:24.711277 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:24.831571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:24.832181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:24.832452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:24.832731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:24.834348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:24.931415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:24.933200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac306db8-7bd5-4936-8b31-adc891d0e2b3 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:24.951058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 697/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:26.085437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1829-f375-4973-876e-9c662aa431ef None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:26.086123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1829-f375-4973-876e-9c662aa431ef None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:26.086123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1829-f375-4973-876e-9c662aa431ef None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:26.088065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:26.094684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c8b0-66e1-458f-b52d-73e64c36065e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:26.095189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c8b0-66e1-458f-b52d-73e64c36065e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:26.095189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523c8b0-66e1-458f-b52d-73e64c36065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:26.115440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:26.177736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8523c8b0-66e1-458f-b52d-73e64c36065e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:26.178970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8523c8b0-66e1-458f-b52d-73e64c36065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:26.287289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:26.442065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e1829-f375-4973-876e-9c662aa431ef None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:26.443747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2e3e1829-f375-4973-876e-9c662aa431ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:26.572776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:26.610953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e1829-f375-4973-876e-9c662aa431ef None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:26.731454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:26.731994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:26.732274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:26.732544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:26.734170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:26.816466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:26.830518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:26.832111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec14a-7c9a-4ad3-95eb-0c6585c8d7ac service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:26.850324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 727/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:27.962748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577df61-06b8-4f8c-9186-03dd8fca597c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:27.963315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577df61-06b8-4f8c-9186-03dd8fca597c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:27.963315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577df61-06b8-4f8c-9186-03dd8fca597c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:27.964630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:27.971161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ccc5-9ca5-483d-82f1-c30be41b8b9f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:27.971701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ccc5-9ca5-483d-82f1-c30be41b8b9f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:27.971701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27ccc5-9ca5-483d-82f1-c30be41b8b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:28.050548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6c27ccc5-9ca5-483d-82f1-c30be41b8b9f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:28.051758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6c27ccc5-9ca5-483d-82f1-c30be41b8b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:28.153579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:28.307428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577df61-06b8-4f8c-9186-03dd8fca597c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:28.309950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0577df61-06b8-4f8c-9186-03dd8fca597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:28.415177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:28.480933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577df61-06b8-4f8c-9186-03dd8fca597c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:28.595848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:28.596374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:28.596665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:28.596950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:28.598550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:28.659533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:28.706754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:28.708526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77284e7d-b254-4595-a6ce-93ad4c473184 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:28.733208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 700/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:29.796111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1baf92-819a-40c0-afae-727a26eb6dfb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:29.797117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1baf92-819a-40c0-afae-727a26eb6dfb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:29.797117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1baf92-819a-40c0-afae-727a26eb6dfb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:29.799129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:29.806871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eb33f-c2e4-4346-a226-93cd4b5eb0d5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:29.807412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eb33f-c2e4-4346-a226-93cd4b5eb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:29.807521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eb33f-c2e4-4346-a226-93cd4b5eb0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:29.890202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b02eb33f-c2e4-4346-a226-93cd4b5eb0d5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:29.892120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b02eb33f-c2e4-4346-a226-93cd4b5eb0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:29.997572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:30.151770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1baf92-819a-40c0-afae-727a26eb6dfb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:30.153890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ef1baf92-819a-40c0-afae-727a26eb6dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:30.206921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:30.307080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1baf92-819a-40c0-afae-727a26eb6dfb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:30.429567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:30.430108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:30.430383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:30.430656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:30.432358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:30.440579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:30.535086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:30.536657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe531e45-e8e8-4f27-bcf2-1a08150fe67d service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:30.554356 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 730/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:31.614679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199f9f-fc30-4fb8-8af7-c5228099ffd1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:31.615276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199f9f-fc30-4fb8-8af7-c5228099ffd1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:31.615276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199f9f-fc30-4fb8-8af7-c5228099ffd1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:31.616565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:31.624311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d0db7-6a43-4db8-8f74-1c57b514dfec None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:31.624820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d0db7-6a43-4db8-8f74-1c57b514dfec None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:31.624927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d0db7-6a43-4db8-8f74-1c57b514dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:31.713621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1f2d0db7-6a43-4db8-8f74-1c57b514dfec None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:31.714835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1f2d0db7-6a43-4db8-8f74-1c57b514dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:31.788337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:31.823925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:31.978673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199f9f-fc30-4fb8-8af7-c5228099ffd1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:31.980729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-63199f9f-fc30-4fb8-8af7-c5228099ffd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:31.999624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:32.132184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199f9f-fc30-4fb8-8af7-c5228099ffd1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:32.237745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:32.265983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:32.266589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:32.266870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:32.267138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:32.268790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:32.367767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:32.370514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8906fbd-dbe3-49a4-b6ab-925ee1fde437 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:32.389878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 703/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:33.443490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995d66-0741-4a35-81aa-fe06d712bbe9 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:33.443992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995d66-0741-4a35-81aa-fe06d712bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:33.443992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995d66-0741-4a35-81aa-fe06d712bbe9 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:33.445438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:33.452595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edf48-6d74-4ca9-8479-f3231824cdaa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:33.453121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edf48-6d74-4ca9-8479-f3231824cdaa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:33.453121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3edf48-6d74-4ca9-8479-f3231824cdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:33.539320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7e3edf48-6d74-4ca9-8479-f3231824cdaa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:33.540551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7e3edf48-6d74-4ca9-8479-f3231824cdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:33.583513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:33.640422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:33.791762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c995d66-0741-4a35-81aa-fe06d712bbe9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:33.795984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c995d66-0741-4a35-81aa-fe06d712bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:33.964269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c995d66-0741-4a35-81aa-fe06d712bbe9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:34.022560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:34.087777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:34.088293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:34.088570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:34.088925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:34.090554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:34.202342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:34.203928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16a61c-1218-41e2-87c1-c65ccb596783 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:34.222555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 733/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:35.277043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d20f5-3cee-47c8-a931-109459f1b91c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:35.277627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d20f5-3cee-47c8-a931-109459f1b91c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:35.277627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d20f5-3cee-47c8-a931-109459f1b91c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:35.278928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:35.286461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9675b6-e95f-4793-808c-c9005a5e6aba None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:35.287222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9675b6-e95f-4793-808c-c9005a5e6aba None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:35.287414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9675b6-e95f-4793-808c-c9005a5e6aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:35.369273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6f9675b6-e95f-4793-808c-c9005a5e6aba None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:35.370942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6f9675b6-e95f-4793-808c-c9005a5e6aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:35.373042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:35.475040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:35.626325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d20f5-3cee-47c8-a931-109459f1b91c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:35.628392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-235d20f5-3cee-47c8-a931-109459f1b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:35.790515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d20f5-3cee-47c8-a931-109459f1b91c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:35.828908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:35.922408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:35.922935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:35.923196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:35.923462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:35.925114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:36.019178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:36.020838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61ac42-f7f5-4042-9996-c81aafb4d31a service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:36.039749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 706/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:38.095123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731444-7345-4c4a-a6e5-772133834c7f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:38.095985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731444-7345-4c4a-a6e5-772133834c7f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:38.095985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731444-7345-4c4a-a6e5-772133834c7f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:38.098215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:38.106460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db262-1fc7-4e04-9967-ef32e1c99034 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:38.106896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db262-1fc7-4e04-9967-ef32e1c99034 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:38.106994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42db262-1fc7-4e04-9967-ef32e1c99034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:38.151244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:38.179009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d42db262-1fc7-4e04-9967-ef32e1c99034 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:38.180215 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d42db262-1fc7-4e04-9967-ef32e1c99034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:38.280939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:38.565859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd731444-7345-4c4a-a6e5-772133834c7f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:38.568122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dd731444-7345-4c4a-a6e5-772133834c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:38.682358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd731444-7345-4c4a-a6e5-772133834c7f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:38.716887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:38.763352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:38.763982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:38.764252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:38.764525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:38.766203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:38.888684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:38.891423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf64447-d365-43d0-baa2-ea4c4bfdd422 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:38.913382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 736/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:41.303161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094089-4e6b-453a-8bcd-5ae101074417 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:41.304061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094089-4e6b-453a-8bcd-5ae101074417 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:41.304061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094089-4e6b-453a-8bcd-5ae101074417 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:41.306077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:41.312351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43df3dd-b5d9-4c5a-bb65-4f141ae589d8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:41.312787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43df3dd-b5d9-4c5a-bb65-4f141ae589d8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:41.312917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43df3dd-b5d9-4c5a-bb65-4f141ae589d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:41.384162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e43df3dd-b5d9-4c5a-bb65-4f141ae589d8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:41.385433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e43df3dd-b5d9-4c5a-bb65-4f141ae589d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:41.398598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:41.486416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:41.774197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094089-4e6b-453a-8bcd-5ae101074417 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:41.776799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a2094089-4e6b-453a-8bcd-5ae101074417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:41.895146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094089-4e6b-453a-8bcd-5ae101074417 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:41.909564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:41.979091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:41.979860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:41.980141 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:41.980406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:41.982051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:42.096212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:42.097594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692e117-793e-42f1-b948-c6c4a8b9a8e3 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:42.115798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 709/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:44.581466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813aaf-4da8-4cc6-aeba-44e044754206 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.582030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813aaf-4da8-4cc6-aeba-44e044754206 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.582030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f813aaf-4da8-4cc6-aeba-44e044754206 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.583380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:44.589919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9332d-58ac-4a30-a7b0-a6065ad97496 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:44.590602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9332d-58ac-4a30-a7b0-a6065ad97496 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:44.590719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9332d-58ac-4a30-a7b0-a6065ad97496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:44.651367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:44.670617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-92f9332d-58ac-4a30-a7b0-a6065ad97496 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:44.672352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-92f9332d-58ac-4a30-a7b0-a6065ad97496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:44.783033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:45.075382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f813aaf-4da8-4cc6-aeba-44e044754206 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:45.077959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6f813aaf-4da8-4cc6-aeba-44e044754206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:45.196830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f813aaf-4da8-4cc6-aeba-44e044754206 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:45.236868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:45.273292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:45.273895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:45.274167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:45.274428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:45.276007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:45.398408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:45.400047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420df25-cf48-4c21-9b76-7df985f11d25 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:45.419745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 739/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:47.665056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95049b-2fbb-4ba3-9473-3603fb2cc151 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:47.665891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95049b-2fbb-4ba3-9473-3603fb2cc151 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:47.665891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95049b-2fbb-4ba3-9473-3603fb2cc151 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:47.668127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:47.677145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0aead-a98d-4171-a04e-a0caa1465e71 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:47.677593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0aead-a98d-4171-a04e-a0caa1465e71 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:47.677713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0aead-a98d-4171-a04e-a0caa1465e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:47.750049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8fe0aead-a98d-4171-a04e-a0caa1465e71 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:47.751239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8fe0aead-a98d-4171-a04e-a0caa1465e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:47.775022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:47.861435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:48.148403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95049b-2fbb-4ba3-9473-3603fb2cc151 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:48.149999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a95049b-2fbb-4ba3-9473-3603fb2cc151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:48.262500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95049b-2fbb-4ba3-9473-3603fb2cc151 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:48.283723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:48.341036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:48.341648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:48.341922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:48.342191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:48.343773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:48.457658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:48.459099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9a6f-5a71-4038-a0ab-432457d5f372 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:48.477773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 712/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:50.698301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356879d5-2bc7-4634-973c-15fde5f16c78 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.698844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356879d5-2bc7-4634-973c-15fde5f16c78 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.698844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356879d5-2bc7-4634-973c-15fde5f16c78 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.700080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:50.705937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d641-d5c5-4436-81f5-17b2aadba3c2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:50.706399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d641-d5c5-4436-81f5-17b2aadba3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:50.706509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d641-d5c5-4436-81f5-17b2aadba3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:50.772401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:50.775489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a040d641-d5c5-4436-81f5-17b2aadba3c2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:50.777202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a040d641-d5c5-4436-81f5-17b2aadba3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:50.878799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:51.164592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356879d5-2bc7-4634-973c-15fde5f16c78 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:51.167099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-356879d5-2bc7-4634-973c-15fde5f16c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:51.287327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356879d5-2bc7-4634-973c-15fde5f16c78 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:51.344787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:51.371919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:51.372567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:51.372874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:51.373144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:51.374786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:51.492039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:51.493529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846bbf0-718d-4e68-81e5-f883235527b1 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:51.514099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 742/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:53.772453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a34df-2668-4c4d-b2fb-c71fcca3717a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:53.773088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a34df-2668-4c4d-b2fb-c71fcca3717a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:53.773088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a34df-2668-4c4d-b2fb-c71fcca3717a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:53.774388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:53.780990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e640f-6ec4-4536-b08e-71d49658c4fa None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:53.781437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e640f-6ec4-4536-b08e-71d49658c4fa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:53.781559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e640f-6ec4-4536-b08e-71d49658c4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:53.859484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3b8e640f-6ec4-4536-b08e-71d49658c4fa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:53.860730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3b8e640f-6ec4-4536-b08e-71d49658c4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:53.891326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:53.970241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:54.272288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a34df-2668-4c4d-b2fb-c71fcca3717a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:54.274898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f47a34df-2668-4c4d-b2fb-c71fcca3717a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:54.387097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a34df-2668-4c4d-b2fb-c71fcca3717a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:54.417700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:54.464891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:54.465502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:54.465774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:54.466044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:54.467604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:54.588889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:54.590269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b47955-2b25-4ac6-89a4-cc754558a1e6 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:54.610062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 715/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:56.826396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e7b3-81c7-4658-9c87-b3054d69712d None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:56.827488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e7b3-81c7-4658-9c87-b3054d69712d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:56.827488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e7b3-81c7-4658-9c87-b3054d69712d None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:56.829475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:56.838454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d20a6-92dd-49b7-a7ec-1887703c7858 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:56.838916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d20a6-92dd-49b7-a7ec-1887703c7858 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:56.839025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d20a6-92dd-49b7-a7ec-1887703c7858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:56.911951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-449d20a6-92dd-49b7-a7ec-1887703c7858 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:56.913364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-449d20a6-92dd-49b7-a7ec-1887703c7858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:56.922520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:57.012667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:51:57.290617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3e7b3-81c7-4658-9c87-b3054d69712d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:51:57.292250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b3d3e7b3-81c7-4658-9c87-b3054d69712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:57.410717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3e7b3-81c7-4658-9c87-b3054d69712d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:51:57.469576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:57.490134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:51:57.490753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:57.491032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:57.491302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:57.492998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:57.604450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:51:57.605922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c4472-05d5-4f17-8b54-5a50a1f436b4 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:51:57.624604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 745/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:51:59.804092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932c985-2b96-428e-90bc-c9bdf565bbae None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:59.804729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932c985-2b96-428e-90bc-c9bdf565bbae None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:59.804729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932c985-2b96-428e-90bc-c9bdf565bbae None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:59.806665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:51:59.815632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706aa2-d48f-470e-a9e7-21b5343d0f69 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:51:59.816144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706aa2-d48f-470e-a9e7-21b5343d0f69 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:51:59.816240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706aa2-d48f-470e-a9e7-21b5343d0f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:51:59.889609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-16706aa2-d48f-470e-a9e7-21b5343d0f69 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:51:59.890822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-16706aa2-d48f-470e-a9e7-21b5343d0f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:51:59.946617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:00.008703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:00.302907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932c985-2b96-428e-90bc-c9bdf565bbae None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:00.305426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a932c985-2b96-428e-90bc-c9bdf565bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:00.420177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932c985-2b96-428e-90bc-c9bdf565bbae None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:00.463480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:00.503238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:00.503849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:00.504123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:00.504391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:00.506045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:00.624288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:00.625689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dddee9-7635-49d3-a93c-1625544b6b10 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:00.646298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 718/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:02.810053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935c816-13c6-4b35-826b-e9887b3b94fb None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:02.810967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935c816-13c6-4b35-826b-e9887b3b94fb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:02.810967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935c816-13c6-4b35-826b-e9887b3b94fb None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:02.813200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:52:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:02.818836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83ec62-d536-4645-ae03-222ea7a5e8b1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:02.819308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83ec62-d536-4645-ae03-222ea7a5e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:02.819402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83ec62-d536-4645-ae03-222ea7a5e8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:02.888516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8d83ec62-d536-4645-ae03-222ea7a5e8b1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:02.889805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8d83ec62-d536-4645-ae03-222ea7a5e8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:02.908264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:02.989569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:03.284408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935c816-13c6-4b35-826b-e9887b3b94fb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:03.285995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f935c816-13c6-4b35-826b-e9887b3b94fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:03.405896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935c816-13c6-4b35-826b-e9887b3b94fb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:03.487431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:03.494874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:03.495479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:03.495761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:03.496025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:03.497680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:03.617172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:03.618613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4524bb5-01c1-43d3-b719-62bfcfece980 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:03.643761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 748/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:52:05.884811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fafdf1-8fff-4d3c-bd90-c1f2d7e12152 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:05.885470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fafdf1-8fff-4d3c-bd90-c1f2d7e12152 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:05.885470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fafdf1-8fff-4d3c-bd90-c1f2d7e12152 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:05.886851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:05.893404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4a35-2c4b-4447-8a54-22f435286481 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:05.893829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4a35-2c4b-4447-8a54-22f435286481 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:05.894034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4a35-2c4b-4447-8a54-22f435286481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:05.969658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0dec4a35-2c4b-4447-8a54-22f435286481 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:05.971166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0dec4a35-2c4b-4447-8a54-22f435286481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:06.021702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:06.074696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:06.358472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fafdf1-8fff-4d3c-bd90-c1f2d7e12152 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:06.361086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-71fafdf1-8fff-4d3c-bd90-c1f2d7e12152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:06.474859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fafdf1-8fff-4d3c-bd90-c1f2d7e12152 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:06.525523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:06.554128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:06.554763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:06.555038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:06.555303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:06.556981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:06.675284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:06.676684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa682a-7e98-4d9f-bacb-25026cea82a5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:06.695802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 721/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:16.072855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=22 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:16.693360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=66 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:26.669493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96f4b-d98b-4eb4-a0f5-f02ab1b1525e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:26.670102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96f4b-d98b-4eb4-a0f5-f02ab1b1525e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:26.670102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e96f4b-d98b-4eb4-a0f5-f02ab1b1525e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:26.671424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 750/1471] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:26.680869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e9e9-0862-4fe5-a642-0f1bffe99dca None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:26.680869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e9e9-0862-4fe5-a642-0f1bffe99dca None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:26.680869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6e9e9-0862-4fe5-a642-0f1bffe99dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:26.756594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dba6e9e9-0862-4fe5-a642-0f1bffe99dca None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:26.757832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dba6e9e9-0862-4fe5-a642-0f1bffe99dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:26.856880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 722/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:27.155860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bc55d-4bab-4882-8f79-3b0e6a979406 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.156139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bc55d-4bab-4882-8f79-3b0e6a979406 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.156412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bc55d-4bab-4882-8f79-3b0e6a979406 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.157819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 751/1473] 10.222.0.65 () {54 vars in 966 bytes} [Tue Sep 13 19:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:27.163603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cdae2-8e6a-4ac3-9c49-2f36d80a54d4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.163882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cdae2-8e6a-4ac3-9c49-2f36d80a54d4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.164153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cdae2-8e6a-4ac3-9c49-2f36d80a54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.239926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8c0cdae2-8e6a-4ac3-9c49-2f36d80a54d4 None None] MFA Rules not processed for user `ebe21ca5e9924e458c2d37c28e7ee1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:27.241142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8c0cdae2-8e6a-4ac3-9c49-2f36d80a54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.263531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:27.324073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 723/1474] 10.222.0.65 () {58 vars in 1063 bytes} [Tue Sep 13 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:27.334995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bc55d-4bab-4882-8f79-3b0e6a979406 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:27.336525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0b5bc55d-4bab-4882-8f79-3b0e6a979406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.463616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bc55d-4bab-4882-8f79-3b0e6a979406 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:27.541562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:27.542172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:27.542446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:27.542720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:27.544424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:27.609158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:27.667974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:27.669437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a414355-b1b7-4769-b8a3-120787663955 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:27.688517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 752/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:29.898824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15cfae-0419-4788-a684-5c7d2e72a8dd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:29.899461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15cfae-0419-4788-a684-5c7d2e72a8dd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:29.899461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15cfae-0419-4788-a684-5c7d2e72a8dd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:29.900786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 724/1476] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:29.906255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d80da-567b-44cc-ad82-ebe295e6e870 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:29.906706 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d80da-567b-44cc-ad82-ebe295e6e870 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:29.906832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d80da-567b-44cc-ad82-ebe295e6e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:29.978882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1e5d80da-567b-44cc-ad82-ebe295e6e870 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:29.980117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1e5d80da-567b-44cc-ad82-ebe295e6e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:30.085718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 753/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:30.355902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15cfae-0419-4788-a684-5c7d2e72a8dd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:30.357786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5f15cfae-0419-4788-a684-5c7d2e72a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:30.496949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15cfae-0419-4788-a684-5c7d2e72a8dd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:30.548496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:30.593961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:30.594578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:30.594858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:30.595128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:30.595767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:30.597636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:52:30.597636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:52:30.597636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:52:30.598786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c98b51-a890-4f4f-ba4b-37fdd29d0a41 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:30.618341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 725/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Sep 13 19:52:30 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:52:32.791736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a13f-4f97-4597-8783-30899bdb02d2 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:32.792325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a13f-4f97-4597-8783-30899bdb02d2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:32.792325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a13f-4f97-4597-8783-30899bdb02d2 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:32.794357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 754/1479] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:32.799921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5404cf-6514-427b-a04a-59022d437d81 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:32.800386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5404cf-6514-427b-a04a-59022d437d81 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:32.800508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5404cf-6514-427b-a04a-59022d437d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:32.874428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9e5404cf-6514-427b-a04a-59022d437d81 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:32.875660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9e5404cf-6514-427b-a04a-59022d437d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:32.990079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 726/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:33.284869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a13f-4f97-4597-8783-30899bdb02d2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:33.286557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f640a13f-4f97-4597-8783-30899bdb02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:33.297145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:33.449432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a13f-4f97-4597-8783-30899bdb02d2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:33.534383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:33.569197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:33.569872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:33.570159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:33.570425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:33.572058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:33.673547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:33.675160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd388c-1dc3-4699-84aa-9bbfdaf11e16 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:33.694410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 755/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:36.050016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9ef58-aa8d-4672-ae88-f176b7dd8a65 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:36.050965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9ef58-aa8d-4672-ae88-f176b7dd8a65 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:36.050965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9ef58-aa8d-4672-ae88-f176b7dd8a65 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:36.053206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 727/1482] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:36.061379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece22e4-e1de-4b0e-a872-8d0c4174099d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:36.061844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece22e4-e1de-4b0e-a872-8d0c4174099d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:36.061844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece22e4-e1de-4b0e-a872-8d0c4174099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:36.128199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-aece22e4-e1de-4b0e-a872-8d0c4174099d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:36.129414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-aece22e4-e1de-4b0e-a872-8d0c4174099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:36.183948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:36.237719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 756/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:36.538830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9ef58-aa8d-4672-ae88-f176b7dd8a65 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:36.541373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fcf9ef58-aa8d-4672-ae88-f176b7dd8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:36.571094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:36.655266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9ef58-aa8d-4672-ae88-f176b7dd8a65 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:36.734189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:36.734716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:36.734985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:36.735251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:36.736878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:36.816535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:36.873763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:36.877476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc45626-8518-4ccc-9dc4-5039d107bf34 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:36.900699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 728/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:39.101292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171c5f-31ce-4cd2-9f68-8ab38c16bdfd None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:39.102197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171c5f-31ce-4cd2-9f68-8ab38c16bdfd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:39.102197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea171c5f-31ce-4cd2-9f68-8ab38c16bdfd None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:39.104367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 757/1485] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:39.113323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881a118-7f07-4d0f-97f8-f9341f64dfd2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:39.113752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881a118-7f07-4d0f-97f8-f9341f64dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:39.113872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881a118-7f07-4d0f-97f8-f9341f64dfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:39.189511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9881a118-7f07-4d0f-97f8-f9341f64dfd2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:39.190765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9881a118-7f07-4d0f-97f8-f9341f64dfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:39.303621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 729/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:39.594497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171c5f-31ce-4cd2-9f68-8ab38c16bdfd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:39.596064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea171c5f-31ce-4cd2-9f68-8ab38c16bdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:39.704732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea171c5f-31ce-4cd2-9f68-8ab38c16bdfd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:39.780406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:39.782054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:39.782785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:39.783041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:39.783436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:39.785531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:39.899801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:39.901277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c2679-e391-4c0c-a16c-6e599eae68a7 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:39.920455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 758/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:52:42.209601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689e5bf-baae-4a7b-95e2-9a700e800006 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:42.210200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689e5bf-baae-4a7b-95e2-9a700e800006 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:42.210200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689e5bf-baae-4a7b-95e2-9a700e800006 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:42.211502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 730/1488] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:42.217373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e42b4-57f7-4836-9e2a-84a9829e2b81 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:42.217833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e42b4-57f7-4836-9e2a-84a9829e2b81 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:42.217939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e42b4-57f7-4836-9e2a-84a9829e2b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:42.289811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b28e42b4-57f7-4836-9e2a-84a9829e2b81 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:42.291013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b28e42b4-57f7-4836-9e2a-84a9829e2b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:42.346032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:42.394567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 759/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:52:42.683140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689e5bf-baae-4a7b-95e2-9a700e800006 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:42.685647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6689e5bf-baae-4a7b-95e2-9a700e800006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:42.728825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:42.811831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689e5bf-baae-4a7b-95e2-9a700e800006 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:42.889527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:42.890140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:42.890417 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:42.890692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:42.892313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:42.980433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:43.012064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:43.013572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c430a8-088b-47b9-b519-764a2a34894c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:43.032933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 731/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:45.528945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406a011-4b9a-42b4-893f-bca2116f2884 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:45.529858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406a011-4b9a-42b4-893f-bca2116f2884 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:45.529858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406a011-4b9a-42b4-893f-bca2116f2884 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:45.531985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 760/1491] 10.222.0.65 () {54 vars in 927 bytes} [Tue Sep 13 19:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:52:45.538467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84499cf-50c3-4708-a9c7-58fe16833777 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:45.539251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84499cf-50c3-4708-a9c7-58fe16833777 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:45.539413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84499cf-50c3-4708-a9c7-58fe16833777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:45.608832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f84499cf-50c3-4708-a9c7-58fe16833777 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:52:45.610055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f84499cf-50c3-4708-a9c7-58fe16833777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:45.711962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 732/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Sep 13 19:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:52:46.000297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406a011-4b9a-42b4-893f-bca2116f2884 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:52:46.001878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e406a011-4b9a-42b4-893f-bca2116f2884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:46.123568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406a011-4b9a-42b4-893f-bca2116f2884 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:52:46.202058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:52:46.202697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:52:46.203001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:52:46.203302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:52:46.204991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:52:46.214878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:46.322058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:52:46.323391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b06ad9-b7e4-4190-b0b3-8f85c207e337 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:52:46.342017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 761/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:52:55.710467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:56.339505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=50 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:21.549082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:21.549967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:21.549967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:21.636649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:21.637862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:21.738079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 733/1494] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:21.747394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:21.747933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:21.747933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:21.830520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:21.831735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:21.944037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 762/1495] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:21.948893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:21.950112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:21.961963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32cfd-9794-4129-81ed-a8b1067f518c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:22.031254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:22.071590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:22.072437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.072741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.073003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:22.073917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:54:22.074509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:22.076016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:22.076016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:54:22.076016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:54:22.077295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:22.091408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 734/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:54:22.100285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:22.109973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2654453-2f91-4d84-8705-8a76d030b85f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:22.177174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:22.213677 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:22.214262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.214534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.214799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:22.215426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:22.217201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:22.217201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:54:22.217201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:54:22.218375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:22.279018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 763/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:54:22 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:22.283733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:22.285287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:22.442319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94526acd-935b-4bcf-99dc-fb7b4c3394ed admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:22.550955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:22.551626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.551736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.551992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:22.552959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:22.554710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:22.554710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:54:22.554710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:54:22.557018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:22.609051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 735/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:54:22 2022] POST /identity/v3/users => generated 290 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:54:22.613447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:22.614989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:22.679256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a8a8a-5426-49e2-922d-a88b9ddb0148 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:22.776133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:22.788316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:22.788971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.789251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.789522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:22.790209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:22.791230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:22.791230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:54:22.791230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:54:22.792129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:22.805167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 764/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:22.809410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:22.810949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:22.822684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd42a-b076-4ac6-91a6-9d340ed2cf22 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:22.852272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:22.926243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:22.926871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:22.927146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:22.927424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:22.928093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:22.929145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:22.929145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:54:22.929145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:54:22.930021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5415794-d33f-446f-bd47-a5ff78915979 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:22.943082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 736/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:54:22.947579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:22.949163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:22.985090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacabb4-40fe-4f6d-8320-3ba6727aaddc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:23.093963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:23.094561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.094843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.095119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] PATH_INFO: `/v3/projects/e70ada5e9eff4a92bee94ca67f0f503e/users/8f5275c233ee419fa055206d42b5afaf/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.120276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70ada5e9eff4a92bee94ca67f0f503e, user_id=8f5275c233ee419fa055206d42b5afaf, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:23.121377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:23.121377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:54:23.121377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:54:23.123299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac78822-81bd-49f4-b4c1-4f5473c621af admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:23.150522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 765/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:54:22 2022] PUT /identity/v3/projects/e70ada5e9eff4a92bee94ca67f0f503e/users/8f5275c233ee419fa055206d42b5afaf/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:23.163217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b58ab-579c-4799-9842-64ee27bbe8c2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.163501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b58ab-579c-4799-9842-64ee27bbe8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.163779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b58ab-579c-4799-9842-64ee27bbe8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.222637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-843b58ab-579c-4799-9842-64ee27bbe8c2 None None] MFA Rules not processed for user `8f5275c233ee419fa055206d42b5afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:23.223853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-843b58ab-579c-4799-9842-64ee27bbe8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.301116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 737/1502] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:54:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:23.314900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fdf9b-9375-46e3-a292-6cd140e47fef None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.315188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fdf9b-9375-46e3-a292-6cd140e47fef None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.315458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fdf9b-9375-46e3-a292-6cd140e47fef None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.316948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 766/1503] 10.222.0.65 () {54 vars in 964 bytes} [Tue Sep 13 19:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:23.321945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab600c8-3b53-49e2-9237-86567fc638ec None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.322226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab600c8-3b53-49e2-9237-86567fc638ec None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.322490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab600c8-3b53-49e2-9237-86567fc638ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.354719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:23.402613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2ab600c8-3b53-49e2-9237-86567fc638ec None None] MFA Rules not processed for user `d81e355fe7294414a24428411ade0019`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:23.403813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2ab600c8-3b53-49e2-9237-86567fc638ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.480812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 738/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Tue Sep 13 19:54:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:23.488894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fdf9b-9375-46e3-a292-6cd140e47fef None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:23.490533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fb1fdf9b-9375-46e3-a292-6cd140e47fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.545822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:23.600182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fdf9b-9375-46e3-a292-6cd140e47fef None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:23.674478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:23.675086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.675366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.675636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.677343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.778157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:23.779584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:23.783106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:23.799383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 767/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:23.846873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ac89b-5377-48cc-b5fd-2accda3b36cd None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.847345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ac89b-5377-48cc-b5fd-2accda3b36cd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.847444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ac89b-5377-48cc-b5fd-2accda3b36cd None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.848661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 739/1506] 10.222.0.65 () {52 vars in 830 bytes} [Tue Sep 13 19:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:23.853948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:23.855212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:23.968412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da8b2-327c-4a62-9ceb-d775c6da4e57 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:24.066649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:24.067273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.067546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.067839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] PATH_INFO: `/v3/users/8f5275c233ee419fa055206d42b5afaf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.082001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5275c233ee419fa055206d42b5afaf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:24.083037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:24.083037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:54:24.083037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:54:24.084262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:24.094478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:24.156309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5275c233ee419fa055206d42b5afaf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.168013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5275c233ee419fa055206d42b5afaf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.168526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5275c233ee419fa055206d42b5afaf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.169001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5275c233ee419fa055206d42b5afaf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.183933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5275c233ee419fa055206d42b5afaf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:24.214147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 768/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:54:23 2022] DELETE /identity/v3/users/8f5275c233ee419fa055206d42b5afaf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:54:24.219083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.219303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.219575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.280073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:24.281337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.362096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:24.376702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 740/1508] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:24.386527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:24.387816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.490905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccaf4b-15b7-4e83-b6c7-dbe4a205926e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:24.547873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:24.569131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:24.569750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:24.570033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:24.570310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.572195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.705479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:24.706909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2047333-59e4-4bb2-b6a1-4270e44e957b service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:24.726218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 769/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:25.116645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:25.117978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:25.131687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a3d6-d61c-47ff-b450-c2d764c23981 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:25.245298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:25.245943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:25.246227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:25.246496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] PATH_INFO: `/v3/projects/e70ada5e9eff4a92bee94ca67f0f503e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:25.257467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70ada5e9eff4a92bee94ca67f0f503e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:25.258546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:54:25.258546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:54:25.258546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:54:25.259742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:25.324562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70ada5e9eff4a92bee94ca67f0f503e', 'request_id': 'req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.339086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70ada5e9eff4a92bee94ca67f0f503e', 'request_id': 'req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.350338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70ada5e9eff4a92bee94ca67f0f503e', 'request_id': 'req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.373310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] The token cache is being invalidate because project e70ada5e9eff4a92bee94ca67f0f503e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:54:25.373593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.374108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f5ddb0f-8593-4bab-90ea-4c9a28d40832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:54:25.375403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 741/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:54:25 2022] DELETE /identity/v3/projects/e70ada5e9eff4a92bee94ca67f0f503e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:54:34.723460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=62 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:35.371267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:59.154534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde5bc-76f9-4e37-88e2-bb219a1bdc1c None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.155607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde5bc-76f9-4e37-88e2-bb219a1bdc1c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.155607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fde5bc-76f9-4e37-88e2-bb219a1bdc1c None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.157682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:59.165827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23265-c554-4a56-9dc4-c26e53c93a3d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.166492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23265-c554-4a56-9dc4-c26e53c93a3d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.166672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23265-c554-4a56-9dc4-c26e53c93a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.255383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5cf23265-c554-4a56-9dc4-c26e53c93a3d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:59.256671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5cf23265-c554-4a56-9dc4-c26e53c93a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.365449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:59.521021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fde5bc-76f9-4e37-88e2-bb219a1bdc1c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:59.524523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-13fde5bc-76f9-4e37-88e2-bb219a1bdc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:59.669529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fde5bc-76f9-4e37-88e2-bb219a1bdc1c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:59.675772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69910ed-da26-44ac-8300-bbebc2373885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:59.676366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69910ed-da26-44ac-8300-bbebc2373885 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:59.676662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69910ed-da26-44ac-8300-bbebc2373885 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:59.676953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69910ed-da26-44ac-8300-bbebc2373885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:59.685483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69910ed-da26-44ac-8300-bbebc2373885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:59.687067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69910ed-da26-44ac-8300-bbebc2373885 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:59.696707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 771/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:00.783014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a92343-e786-44aa-8e76-d2698b078a9c None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:00.783608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a92343-e786-44aa-8e76-d2698b078a9c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:00.783608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a92343-e786-44aa-8e76-d2698b078a9c None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:00.785021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:00.792282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa262d-d5ac-416e-9352-234036d36781 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:00.793078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa262d-d5ac-416e-9352-234036d36781 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:00.793284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa262d-d5ac-416e-9352-234036d36781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:00.816792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-50aa262d-d5ac-416e-9352-234036d36781 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:00.818008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50aa262d-d5ac-416e-9352-234036d36781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:00.826663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:00.981698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a92343-e786-44aa-8e76-d2698b078a9c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:00.998906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a92343-e786-44aa-8e76-d2698b078a9c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:01.007220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba5f6-865f-4be4-8151-943d2cb0b9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:01.007829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba5f6-865f-4be4-8151-943d2cb0b9ea service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.008107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba5f6-865f-4be4-8151-943d2cb0b9ea service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.008377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba5f6-865f-4be4-8151-943d2cb0b9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.017572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ba5f6-865f-4be4-8151-943d2cb0b9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:01.019175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ba5f6-865f-4be4-8151-943d2cb0b9ea service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:01.029258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 744/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:01.644918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20e849-fec3-443d-9131-0676e73ef783 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.645838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20e849-fec3-443d-9131-0676e73ef783 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.646262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20e849-fec3-443d-9131-0676e73ef783 None None] PATH_INFO: `/v3` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.648180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 773/1517] 10.222.0.60 () {54 vars in 925 bytes} [Tue Sep 13 19:56:01 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:56:01.657406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293aef1-2228-4951-bca9-9d4ad03f00a8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.657848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293aef1-2228-4951-bca9-9d4ad03f00a8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.658261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293aef1-2228-4951-bca9-9d4ad03f00a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.722690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7293aef1-2228-4951-bca9-9d4ad03f00a8 None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:01.723824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7293aef1-2228-4951-bca9-9d4ad03f00a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:01.741555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:01.799849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 745/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Sep 13 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:05.482122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6950c4-c291-4e8e-9505-3ddec525956a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:05.482675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6950c4-c291-4e8e-9505-3ddec525956a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:05.482675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6950c4-c291-4e8e-9505-3ddec525956a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:05.484007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 774/1519] 10.222.0.65 () {54 vars in 961 bytes} [Tue Sep 13 19:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:05.489355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7cad4-d123-4ccc-9bd2-661921a31bf6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:05.489928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7cad4-d123-4ccc-9bd2-661921a31bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:05.489928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7cad4-d123-4ccc-9bd2-661921a31bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:05.510994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-faa7cad4-d123-4ccc-9bd2-661921a31bf6 None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:05.512201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-faa7cad4-d123-4ccc-9bd2-661921a31bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:05.522384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 746/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Tue Sep 13 19:56:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:05.530184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6950c4-c291-4e8e-9505-3ddec525956a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:05.548463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6950c4-c291-4e8e-9505-3ddec525956a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:05.556668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5fe41-dbf4-45cb-9f7d-cdc4ecbbbed8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:05.557524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5fe41-dbf4-45cb-9f7d-cdc4ecbbbed8 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:05.557906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5fe41-dbf4-45cb-9f7d-cdc4ecbbbed8 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:05.558253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5fe41-dbf4-45cb-9f7d-cdc4ecbbbed8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:05.569896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5fe41-dbf4-45cb-9f7d-cdc4ecbbbed8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:05.571487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5fe41-dbf4-45cb-9f7d-cdc4ecbbbed8 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:05.580970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 775/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:12.560953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc7763-5771-4bea-b77e-147f62084b88 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:12.561811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc7763-5771-4bea-b77e-147f62084b88 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:12.561811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc7763-5771-4bea-b77e-147f62084b88 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:12.563748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:12.571403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21803d3-ac46-4785-b6f2-6a721d79e178 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:12.572201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21803d3-ac46-4785-b6f2-6a721d79e178 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:12.572375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21803d3-ac46-4785-b6f2-6a721d79e178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:12.598413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a21803d3-ac46-4785-b6f2-6a721d79e178 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:12.599623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a21803d3-ac46-4785-b6f2-6a721d79e178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:12.609117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:12.761623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc7763-5771-4bea-b77e-147f62084b88 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:12.777249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc7763-5771-4bea-b77e-147f62084b88 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:12.783066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273d6ed-fec6-41e2-ad9c-039fc77c3794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:12.783672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d6ed-fec6-41e2-ad9c-039fc77c3794 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:12.783943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d6ed-fec6-41e2-ad9c-039fc77c3794 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:12.784186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273d6ed-fec6-41e2-ad9c-039fc77c3794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:12.792353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273d6ed-fec6-41e2-ad9c-039fc77c3794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:12.793988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273d6ed-fec6-41e2-ad9c-039fc77c3794 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:12.803217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 748/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:13.866149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06fd1-0a42-49ab-9268-c722a0708d1a None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:13.866762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06fd1-0a42-49ab-9268-c722a0708d1a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:13.866762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06fd1-0a42-49ab-9268-c722a0708d1a None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:13.868087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:13.875198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda90-3ba2-4958-8e6b-e92b131bf86e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:13.875661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda90-3ba2-4958-8e6b-e92b131bf86e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:13.875754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda90-3ba2-4958-8e6b-e92b131bf86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:13.896978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ba7bda90-3ba2-4958-8e6b-e92b131bf86e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:13.898151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba7bda90-3ba2-4958-8e6b-e92b131bf86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:13.907481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:14.059235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06fd1-0a42-49ab-9268-c722a0708d1a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:14.084044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06fd1-0a42-49ab-9268-c722a0708d1a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:14.092534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016b29b-865d-40ff-a357-d5c1328340eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:14.093170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016b29b-865d-40ff-a357-d5c1328340eb service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:14.093450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016b29b-865d-40ff-a357-d5c1328340eb service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:14.093718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016b29b-865d-40ff-a357-d5c1328340eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:14.102597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016b29b-865d-40ff-a357-d5c1328340eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:14.104181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016b29b-865d-40ff-a357-d5c1328340eb service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:14.113734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 778/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:18.218145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601602-8d40-4445-bb66-bbe8d3adb11a None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:18.218754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601602-8d40-4445-bb66-bbe8d3adb11a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:18.218754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c601602-8d40-4445-bb66-bbe8d3adb11a None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:18.220120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:18.227072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754e70-990f-4fd7-b57d-838479989273 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:18.227775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754e70-990f-4fd7-b57d-838479989273 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:18.228148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754e70-990f-4fd7-b57d-838479989273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:18.249068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ae754e70-990f-4fd7-b57d-838479989273 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:18.250250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ae754e70-990f-4fd7-b57d-838479989273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:18.258606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:18.546478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c601602-8d40-4445-bb66-bbe8d3adb11a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:18.548600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0c601602-8d40-4445-bb66-bbe8d3adb11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:18.635659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c601602-8d40-4445-bb66-bbe8d3adb11a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:18.639834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a6340-9380-470b-a5b4-559e47af99f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:18.640439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6340-9380-470b-a5b4-559e47af99f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:18.640742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6340-9380-470b-a5b4-559e47af99f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:18.641011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a6340-9380-470b-a5b4-559e47af99f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:18.650435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6340-9380-470b-a5b4-559e47af99f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:18.651863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a6340-9380-470b-a5b4-559e47af99f0 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:18.661229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 751/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:56:20.833076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957676-018d-4035-b72a-ac4c50b6b00f None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:20.833942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957676-018d-4035-b72a-ac4c50b6b00f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:20.833942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22957676-018d-4035-b72a-ac4c50b6b00f None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:20.836046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:20.842249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b724-664a-4be2-a8ce-71a213436e6f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:20.842685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b724-664a-4be2-a8ce-71a213436e6f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:20.842804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b724-664a-4be2-a8ce-71a213436e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:20.863030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c8b9b724-664a-4be2-a8ce-71a213436e6f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:20.864225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c8b9b724-664a-4be2-a8ce-71a213436e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:20.874178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:21.160841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957676-018d-4035-b72a-ac4c50b6b00f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:21.175676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22957676-018d-4035-b72a-ac4c50b6b00f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:21.179882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ddaa5-777c-4723-8329-d302d116da79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:21.180488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ddaa5-777c-4723-8329-d302d116da79 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:21.180798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ddaa5-777c-4723-8329-d302d116da79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:21.181068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ddaa5-777c-4723-8329-d302d116da79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:21.191713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ddaa5-777c-4723-8329-d302d116da79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:21.193366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ddaa5-777c-4723-8329-d302d116da79 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:21.204383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 781/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:24.932893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcc4c-ad10-4826-b2f1-fea21106cf72 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:24.933875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcc4c-ad10-4826-b2f1-fea21106cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:24.933875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddcc4c-ad10-4826-b2f1-fea21106cf72 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:24.935898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:24.944820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef98a1-5d4a-4c8e-8590-421526a61be7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:24.945525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef98a1-5d4a-4c8e-8590-421526a61be7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:24.945676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef98a1-5d4a-4c8e-8590-421526a61be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:24.955789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=81 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:24.974959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-69ef98a1-5d4a-4c8e-8590-421526a61be7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:24.976189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-69ef98a1-5d4a-4c8e-8590-421526a61be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:24.985205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:25.293424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcc4c-ad10-4826-b2f1-fea21106cf72 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:25.296599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-08ddcc4c-ad10-4826-b2f1-fea21106cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:25.367575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:25.383686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ddcc4c-ad10-4826-b2f1-fea21106cf72 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:25.387914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d8dcf-9d4a-4248-bb31-9eb8b84a57a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:25.388557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8dcf-9d4a-4248-bb31-9eb8b84a57a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:25.388862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8dcf-9d4a-4248-bb31-9eb8b84a57a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:25.389133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d8dcf-9d4a-4248-bb31-9eb8b84a57a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:25.398212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d8dcf-9d4a-4248-bb31-9eb8b84a57a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:25.399648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d8dcf-9d4a-4248-bb31-9eb8b84a57a1 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:25.409646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 754/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:27.546004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9ff5-3ed2-4c98-bdb4-5730ffaa05ab None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:27.546589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9ff5-3ed2-4c98-bdb4-5730ffaa05ab None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:27.546589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a9ff5-3ed2-4c98-bdb4-5730ffaa05ab None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:27.547815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:27.554519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548c029-aaaf-4cad-9192-7d2b434669d3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:27.555214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548c029-aaaf-4cad-9192-7d2b434669d3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:27.555361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548c029-aaaf-4cad-9192-7d2b434669d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:27.585598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d548c029-aaaf-4cad-9192-7d2b434669d3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:27.587294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d548c029-aaaf-4cad-9192-7d2b434669d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:27.597223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:27.900301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9ff5-3ed2-4c98-bdb4-5730ffaa05ab None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:27.902231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6f2a9ff5-3ed2-4c98-bdb4-5730ffaa05ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:27.916790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a9ff5-3ed2-4c98-bdb4-5730ffaa05ab None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:27.920883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaac9d4-cb97-43d9-bf0a-01fb0d449fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:27.921482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac9d4-cb97-43d9-bf0a-01fb0d449fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:27.921761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac9d4-cb97-43d9-bf0a-01fb0d449fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:27.922037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaac9d4-cb97-43d9-bf0a-01fb0d449fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:27.931229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaac9d4-cb97-43d9-bf0a-01fb0d449fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:27.932642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaac9d4-cb97-43d9-bf0a-01fb0d449fb3 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:27.942590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 784/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:37.577590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=11 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:37.938055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=8 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:55.202230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.203374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.203877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.229997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.231395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.240622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 756/1540] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.249593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.250203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.250203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.282033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.283287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.297110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 785/1541] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.301692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.316289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cecbb-9e9c-48aa-9373-2648e7c6dfcb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.325428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.326074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.326350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.326608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.327318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:55.327615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.329304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.342909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 757/1542] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:55.351036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.364552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d76601-4f55-4eae-90dc-75847ee0cbcb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.373370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0bb44-6812-49c0-a1e0-adb62f5a9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.374003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0bb44-6812-49c0-a1e0-adb62f5a9e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.374286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0bb44-6812-49c0-a1e0-adb62f5a9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.374557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0bb44-6812-49c0-a1e0-adb62f5a9e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.375343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0bb44-6812-49c0-a1e0-adb62f5a9e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.377298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0bb44-6812-49c0-a1e0-adb62f5a9e79 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.445969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 786/1543] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:55.449927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.466371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281bd6-8a2e-42ae-9c56-7795ad813cc9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.478310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73a342-f82b-48d2-9b85-237df883ee33 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.478673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73a342-f82b-48d2-9b85-237df883ee33 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.478871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73a342-f82b-48d2-9b85-237df883ee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.509849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4c73a342-f82b-48d2-9b85-237df883ee33 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.511098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4c73a342-f82b-48d2-9b85-237df883ee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.563042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e890-8074-44cb-a5b2-a46da66f8fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.563672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e890-8074-44cb-a5b2-a46da66f8fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.564015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e890-8074-44cb-a5b2-a46da66f8fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.564202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e890-8074-44cb-a5b2-a46da66f8fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.565753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e890-8074-44cb-a5b2-a46da66f8fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.567711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e890-8074-44cb-a5b2-a46da66f8fe9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.611882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 787/1544] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.613934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704c3e-ae4a-4bf7-8606-09384eed0168 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.614454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704c3e-ae4a-4bf7-8606-09384eed0168 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.615063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92704c3e-ae4a-4bf7-8606-09384eed0168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.628827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 758/1545] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:55.630159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90546fce-afee-4415-ac9f-f0e4bac06f2a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.630438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90546fce-afee-4415-ac9f-f0e4bac06f2a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.630706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90546fce-afee-4415-ac9f-f0e4bac06f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.642273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-92704c3e-ae4a-4bf7-8606-09384eed0168 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.643501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-92704c3e-ae4a-4bf7-8606-09384eed0168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.653322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 788/1546] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.654445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.654733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.655055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.660394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-90546fce-afee-4415-ac9f-f0e4bac06f2a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.661966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-90546fce-afee-4415-ac9f-f0e4bac06f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.672876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 759/1547] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.677297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122c68-9466-4c17-97b1-c65b7485d7f1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.678110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122c68-9466-4c17-97b1-c65b7485d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.678419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75122c68-9466-4c17-97b1-c65b7485d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.687330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.688669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.699945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 789/1548] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.705319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.708725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-75122c68-9466-4c17-97b1-c65b7485d7f1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.709936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-75122c68-9466-4c17-97b1-c65b7485d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.722970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c5541-1bf2-4606-b072-11585e1fe423 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.723688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 760/1549] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.725202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165563f-b14f-4f80-bd6c-ae25b4fe556d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.725496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165563f-b14f-4f80-bd6c-ae25b4fe556d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.725768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165563f-b14f-4f80-bd6c-ae25b4fe556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.733165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927c898-0617-48d8-98fc-3d5a3bc61d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.734034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c898-0617-48d8-98fc-3d5a3bc61d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.734318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c898-0617-48d8-98fc-3d5a3bc61d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.735639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927c898-0617-48d8-98fc-3d5a3bc61d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.736310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927c898-0617-48d8-98fc-3d5a3bc61d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.737944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927c898-0617-48d8-98fc-3d5a3bc61d17 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.746965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0165563f-b14f-4f80-bd6c-ae25b4fe556d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.748161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0165563f-b14f-4f80-bd6c-ae25b4fe556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.751406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 790/1550] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:55.752176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d894b-c08a-4eb0-9a22-7ab3f4ccb160 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.752176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d894b-c08a-4eb0-9a22-7ab3f4ccb160 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.752176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d894b-c08a-4eb0-9a22-7ab3f4ccb160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.756161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 761/1551] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.757385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe24539-b0c8-4994-bd41-1fb5e0d9e103 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.757657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe24539-b0c8-4994-bd41-1fb5e0d9e103 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.757992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe24539-b0c8-4994-bd41-1fb5e0d9e103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.772315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8c2d894b-c08a-4eb0-9a22-7ab3f4ccb160 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.773563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c2d894b-c08a-4eb0-9a22-7ab3f4ccb160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.779634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-afe24539-b0c8-4994-bd41-1fb5e0d9e103 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.780819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-afe24539-b0c8-4994-bd41-1fb5e0d9e103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.781638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 791/1552] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.782892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c82f6-f555-4314-b438-bb8936609661 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.783175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c82f6-f555-4314-b438-bb8936609661 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.783447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c82f6-f555-4314-b438-bb8936609661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.788586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 762/1553] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.789792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7936ef-4cdd-499e-a941-ef69ef04690a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.790070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7936ef-4cdd-499e-a941-ef69ef04690a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.790331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7936ef-4cdd-499e-a941-ef69ef04690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.803988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-127c82f6-f555-4314-b438-bb8936609661 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.805202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-127c82f6-f555-4314-b438-bb8936609661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.809254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3f7936ef-4cdd-499e-a941-ef69ef04690a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.810396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3f7936ef-4cdd-499e-a941-ef69ef04690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.813203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 792/1554] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.813974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c82f6-f555-4314-b438-bb8936609661 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.821563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 763/1555] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.821563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ccc80-68a9-4492-82a1-6de03354c062 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.821563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ccc80-68a9-4492-82a1-6de03354c062 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.821563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ccc80-68a9-4492-82a1-6de03354c062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.827228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c82f6-f555-4314-b438-bb8936609661 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.831871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.832468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.832783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.833053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.833696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:55.833997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.835010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:57:55.835010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:57:55.835010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:57:55.835891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.839327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f49ccc80-68a9-4492-82a1-6de03354c062 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.840541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f49ccc80-68a9-4492-82a1-6de03354c062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.848057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 793/1556] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:55.852646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 764/1557] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.852781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.852912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.852912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.852912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.864693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066990f7-2e33-4f7d-a09e-191bb64e5bfa admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.869870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.870472 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.870822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.871088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.871714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.872220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.873333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.873460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.881200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 765/1558] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.881988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.887012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 794/1559] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:55.887012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.891415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5387-4055-41de-80e2-048eb9bc4180 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.896047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054709bf-625e-45f8-97ce-1ee85f7b75f3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.896204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.896727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.897026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.897299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.898062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:55.898361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.899966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52ea6-44a8-494a-994b-2ae9b41a9132 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.900581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.901194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.901478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.901746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.902426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:55.902725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.904291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.911925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 766/1560] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:55.913197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.913478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.913752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.924048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 795/1561] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:55.925070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.933512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.934739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.937181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77d10b-dbee-4087-8def-beadc1ffc0c4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.941903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.942506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.942781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.942895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 767/1562] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.943052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.943516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.943754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:55.944060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.945689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b873b7-02af-4dc0-9a79-55d174e53134 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.952505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6980-c167-476a-be62-eaf4d18b39a8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:55.957052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:55.957635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.957911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.958197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 796/1563] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:55.958434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.959063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:55.959581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:55.959872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:55.960088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:57:55.960088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:57:55.960088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:57:55.960312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:55.961287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:55.979467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:55.981169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:55.989297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 797/1564] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:55.990132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 768/1565] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:55.990267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:55.990864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.000889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6703db-e43c-422f-ac98-72aff7a0d8db None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.030169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:56.042003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:56.061398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485a522-2c4a-4557-84c3-f605377b2772 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.064824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.065552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.065830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.066098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.066671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.066786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:56.067023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.067505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.067843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.068173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] PATH_INFO: `/v3/projects/aeb76a6d5c5c48c9b8f5feffaaa8b324/users/4a622e55c09341c788ad6335b592279d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.068661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.081606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 798/1566] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:56.083045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.083998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb76a6d5c5c48c9b8f5feffaaa8b324, user_id=4a622e55c09341c788ad6335b592279d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.085071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:57:56.085071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:57:56.085071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:57:56.086973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.094499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5dfe-59f5-4c7e-aa40-aeaf34b5c179 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.099742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.100344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.100645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.100916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.101565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.101887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 769/1567] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:55 2022] PUT /identity/v3/projects/aeb76a6d5c5c48c9b8f5feffaaa8b324/users/4a622e55c09341c788ad6335b592279d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:56.112899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.113010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.134863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 799/1568] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.135813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.166390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e3a1b-390f-4b29-8dea-aa3082427ff9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.205032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f96a67-bc9e-415f-aa7a-dbce6d47ab49 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.209812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.210513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.210880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.211134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.211804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:56.212103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.213870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.225227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 800/1569] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:56.226008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.229852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.230504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.230771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.231043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.232107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.233783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.235601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9c4f7-6dd0-4119-a94d-dc75ec6c8c29 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.240293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.240913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.241193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.241464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.242099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.243998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.262176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 770/1570] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.263177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.274113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 801/1571] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.274937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.324310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:56.328284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bea0dc-2034-4a36-b96c-314cded4cecd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.341274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c237f67-2c77-460f-8002-0a5e38e4155b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.346095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.346704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.346978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.347249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.347874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.348909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:57:56.348909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:57:56.348909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:57:56.350121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.373829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 802/1572] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.374529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.379372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:56.384686 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960aa8-f9d3-424c-891e-464b266f5899 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.387667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.388306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.388581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.388877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.389519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:57:56.389818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.391190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.391423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c978b-c6cb-44a3-beb3-8c8a467dbe8c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.391861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.392141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.392411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.393237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.395138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.410068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 771/1573] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:57:56.410068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.410068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.410068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.424507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 803/1574] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.425369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.436034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] MFA Rules not processed for user `4a622e55c09341c788ad6335b592279d`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:56.437298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:56.489488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d126c-47f4-4903-ba99-62eb9882978e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.494701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.495307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.495674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.495949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.496576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.498520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.505441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 772/1575] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:56.506262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.517137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952bc8-fa70-406c-a561-f2491f75929e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.521246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 804/1576] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.522083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.525772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.526382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.526796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.526967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.527609 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.529835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.531716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b42c73-3413-4294-b34f-ee42f9256117 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.536358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.536979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.537251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.537516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.538141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.540018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.561706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 773/1577] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.561706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.561978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 805/1578] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.562500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.574056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7b4ea-a51e-442a-8f88-ca0e2edaab23 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.628897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d14380-de29-4284-9e96-ee889aac164e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.634605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.635224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.635503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.635800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.636440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.636573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.637094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.637365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.637627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.638266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.638498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.639828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.650030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:56.650255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 806/1579] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.651158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.661988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82ea3-ddaa-480d-8944-f68dca3ed1c6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.668314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 774/1580] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.668314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.668928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.669553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.669817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.670085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.670712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.672649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.677692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37158ee8-013e-4698-b908-895ec342a5e3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.682364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.682948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.683231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.683524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.684143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.686073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.701548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 807/1581] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.705539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.707590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 775/1582] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.708423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.717826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c0167-cc42-468c-832a-1b2607749d9f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.737106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:56.771895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893ecda-8b7a-43ac-9283-d2c6bfd3a570 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.776919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.777100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.777554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.777678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.777873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.777990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.778170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.778362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.778833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.778953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.780390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.780902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.790101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 776/1583] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.790945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.800433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066955-f054-472b-8855-412bf9cda4a7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.805166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.805751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.806122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.806396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.807017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.808991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.813694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 808/1584] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.813694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.835410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 777/1585] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.835410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.842976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637550f-d85d-422f-a5d2-75010c9bdb30 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.878364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51459e-7027-41ff-a352-8fabb91a8d2a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.884032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.885045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.885045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.885308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.885942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.887620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.897626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 809/1586] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.901460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.904524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.905199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.905490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.905757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.906477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.908131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.910830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5a008-9b6b-4b84-8d46-165325d5b8a9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.915823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.916406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.916794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.917083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.917925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 778/1587] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.918254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.919815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.921493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.933708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 810/1588] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.933898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e1b03-6baa-4807-b3ff-a3e8130e826c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.933988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.936409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.937046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.937333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.937592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.938245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.940143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.941193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8800-a194-4756-83d6-69fd14d99476 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.945730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.946312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.946588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.946859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.947484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.949489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.960241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 811/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.961140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.966025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 779/1590] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:56.967260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:56.974370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b44e25-a1a3-4697-bca0-c133f22eb7dc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.977444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe187b-5b9a-4e50-bf90-a85136180995 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:56.979146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.979766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.980099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.980377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.981071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.982405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:56.982665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.983061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:56.983345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:56.983618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:56.984248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:56.986188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:56.992558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 812/1591] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:56.995639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.007003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e889b69-d081-4b96-95e0-3933330c0f07 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.011836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 780/1592] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:57:56 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:57:57.011836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.012102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.012739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.013020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.013294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.013971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.015551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.019423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b92b86-ab50-46b1-8e7b-11a897e8b1c0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.024577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.025104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.025379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.025651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.029090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 813/1593] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.029225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.029319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.029399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.036436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1e7f5-b62f-4e36-ad11-3252458a7b66 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.038502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 781/1594] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.042017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.044380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.045063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.045343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.045611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] PATH_INFO: `/v3/projects/29d85efb54b2496b90f5b407e4674381/users/c1ce97baf7cb4711812767724908a984/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.051918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd335e-ad3a-4daa-bd25-6d0e969c94cf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.056930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.057547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.057822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.058149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.058774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.060119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d85efb54b2496b90f5b407e4674381, user_id=c1ce97baf7cb4711812767724908a984, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.060345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.061649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:57.062819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.075273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 782/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.075273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.078992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 814/1596] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/29d85efb54b2496b90f5b407e4674381/users/c1ce97baf7cb4711812767724908a984/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.083902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.084211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa28fd-ec30-4f40-bbd6-0756d7dadb7b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.124500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:57.141225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.141847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.142158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.142424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.143177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.144727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3c7a2-a02e-4e54-b5e1-bba77244d524 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.144841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.150585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.151198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.151641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.152005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.152675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.154257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.154632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 783/1597] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.155407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.164635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 815/1598] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.164872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3e9a-2a3c-45a1-a73e-4f88b9838cc9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.165509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.169689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.170321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.170594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.170857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] PATH_INFO: `/v3/projects/c1c0e1368e334ecc960440e6af5a3a0b/users/70bd24d26f2b4eeb87442d969858fb85/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.175009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ad6b5-b69b-48cf-ab51-5c8cbba14a75 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.179765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.180347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.180665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.180932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.181555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.183231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.185974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c0e1368e334ecc960440e6af5a3a0b, user_id=70bd24d26f2b4eeb87442d969858fb85, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.188692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.192886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 816/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.193919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.204149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ca673-7c68-419e-b2ba-1d3e61bd4d29 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.205918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 784/1600] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/c1c0e1368e334ecc960440e6af5a3a0b/users/70bd24d26f2b4eeb87442d969858fb85/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.206692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.268299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.268951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.269229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.269507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.270155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.271753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.275432 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931bca5-0b6c-4e9b-a788-7bf3c859fc9e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.282043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdf752-0c5c-460e-8a59-6f96f4d10b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.282586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 817/1601] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.283391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf752-0c5c-460e-8a59-6f96f4d10b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.283722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.283850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf752-0c5c-460e-8a59-6f96f4d10b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.283960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdf752-0c5c-460e-8a59-6f96f4d10b16 admin admin] PATH_INFO: `/v3/projects/661fd9814f0d40af988d07eee6f89057/users/f7356d1144b14a4da1191729e2baafad/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.293953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1338dc7-6880-45c0-8b1e-08d7997cd3dd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.298824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.299488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.299762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.300049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] PATH_INFO: `/v3/projects/062abfa9c3354463a3db8486dea5413a/users/cabb7c0ca0714384a8ad38890e12636b/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.301032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdf752-0c5c-460e-8a59-6f96f4d10b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661fd9814f0d40af988d07eee6f89057, user_id=f7356d1144b14a4da1191729e2baafad, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.303666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdf752-0c5c-460e-8a59-6f96f4d10b16 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.318093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 785/1602] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/661fd9814f0d40af988d07eee6f89057/users/f7356d1144b14a4da1191729e2baafad/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.319404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.319687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.319956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.323145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=062abfa9c3354463a3db8486dea5413a, user_id=cabb7c0ca0714384a8ad38890e12636b, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.325896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.339470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 818/1603] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/062abfa9c3354463a3db8486dea5413a/users/cabb7c0ca0714384a8ad38890e12636b/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.340176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:57.341464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.341631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:57.387800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:57.403167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 786/1604] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:57.403993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.404584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bc4f2-6ba5-488c-9aa3-3a4500c8e30c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.409825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa2b8d-adfd-44aa-9688-3abc189e5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.410674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa2b8d-adfd-44aa-9688-3abc189e5218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.410955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa2b8d-adfd-44aa-9688-3abc189e5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.411223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa2b8d-adfd-44aa-9688-3abc189e5218 admin admin] PATH_INFO: `/v3/projects/94106a5745e54651a48c1e43d7752120/users/285df012f70e4176ac99f05cd8271b44/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.413738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b643f-e463-4c48-90ed-7a203a438c7b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.418478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.419089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.419369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.419638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.420315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.421950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.428511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa2b8d-adfd-44aa-9688-3abc189e5218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94106a5745e54651a48c1e43d7752120, user_id=285df012f70e4176ac99f05cd8271b44, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.431387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa2b8d-adfd-44aa-9688-3abc189e5218 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.432335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 787/1605] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.433205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.445453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66076-572d-4774-bc08-da70e69e3647 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.446707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 819/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/94106a5745e54651a48c1e43d7752120/users/285df012f70e4176ac99f05cd8271b44/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.448207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe629fb-6ab1-44db-8ee0-4832b7831a1c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.448496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe629fb-6ab1-44db-8ee0-4832b7831a1c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.448876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe629fb-6ab1-44db-8ee0-4832b7831a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.477926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0fe629fb-6ab1-44db-8ee0-4832b7831a1c None None] MFA Rules not processed for user `70bd24d26f2b4eeb87442d969858fb85`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:57.479144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0fe629fb-6ab1-44db-8ee0-4832b7831a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:57.487395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:57.506249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.506914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.507189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.507460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] PATH_INFO: `/v3/projects/85d1f4068ad44bfebd6b0d26c12f9520/users/52ce333826454e23b97586413c7417b8/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.521589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d1f4068ad44bfebd6b0d26c12f9520, user_id=52ce333826454e23b97586413c7417b8, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.524254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.538788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 788/1607] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/85d1f4068ad44bfebd6b0d26c12f9520/users/52ce333826454e23b97586413c7417b8/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.539763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.549906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 820/1608] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:57.551229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2bc8-db41-49b7-a3bb-8a55fd6efefc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.551519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2bc8-db41-49b7-a3bb-8a55fd6efefc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.551820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2bc8-db41-49b7-a3bb-8a55fd6efefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.570249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a03d2bc8-db41-49b7-a3bb-8a55fd6efefc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:57.571490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a03d2bc8-db41-49b7-a3bb-8a55fd6efefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:57.607580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33e609-4607-4076-827e-fe878f4661ca admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.612473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.613148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.613407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.613680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] PATH_INFO: `/v3/projects/63512bf9bbaf4d70b704f605f11165be/users/f6f461c1133042a19b8c33bfe7e9dd6a/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.628270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63512bf9bbaf4d70b704f605f11165be, user_id=f6f461c1133042a19b8c33bfe7e9dd6a, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.630990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.632576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 821/1609] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:57.634029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.634311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.634581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.648128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 789/1610] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/63512bf9bbaf4d70b704f605f11165be/users/f6f461c1133042a19b8c33bfe7e9dd6a/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.649007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.662893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:57.664128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:57.701030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:57.707326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ff72-faa7-4621-a9a2-220a597b0c22 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.711717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.712315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.712592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.712929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.722784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 822/1611] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:57.723666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.733165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a807d-b723-4900-bfd0-6e1b08daa5d9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.738040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52227-93fa-413b-b869-d8fb1e517ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.738699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52227-93fa-413b-b869-d8fb1e517ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.738977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52227-93fa-413b-b869-d8fb1e517ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.739248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52227-93fa-413b-b869-d8fb1e517ab8 admin admin] PATH_INFO: `/v3/projects/fb095946b94e4da2b6f90ab7eae34fdf/users/cea89d871eb14900bb3988721446c489/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.754884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f52227-93fa-413b-b869-d8fb1e517ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb095946b94e4da2b6f90ab7eae34fdf, user_id=cea89d871eb14900bb3988721446c489, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.757473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f52227-93fa-413b-b869-d8fb1e517ab8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.771613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 823/1612] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:57 2022] PUT /identity/v3/projects/fb095946b94e4da2b6f90ab7eae34fdf/users/cea89d871eb14900bb3988721446c489/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:57.773225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b923-3795-47a7-bcd3-aa80fe9d0afd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.773533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b923-3795-47a7-bcd3-aa80fe9d0afd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.773808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58b923-3795-47a7-bcd3-aa80fe9d0afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.780908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.782435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.792226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 790/1613] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:57.792704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ac58b923-3795-47a7-bcd3-aa80fe9d0afd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:57.793020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.793903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ac58b923-3795-47a7-bcd3-aa80fe9d0afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:57.802387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d602-cf3c-4364-ae4b-3bae1c820c05 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.816117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:57.865815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 824/1614] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:57.867451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c337c-6447-447e-bded-0bb098efb4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.868009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535999b-c507-4190-8899-d680f2868586 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.868376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c337c-6447-447e-bded-0bb098efb4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.868495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535999b-c507-4190-8899-d680f2868586 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.868580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c337c-6447-447e-bded-0bb098efb4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.868702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535999b-c507-4190-8899-d680f2868586 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.868955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c337c-6447-447e-bded-0bb098efb4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.870068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c337c-6447-447e-bded-0bb098efb4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.872074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c337c-6447-447e-bded-0bb098efb4eb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.872804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 825/1615] 10.222.0.65 () {54 vars in 962 bytes} [Tue Sep 13 19:57:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:57:57.874607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535999b-c507-4190-8899-d680f2868586 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.891804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 791/1616] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:57:57.891804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201433c2-e0f6-4b12-b7c5-f449de75bf4c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.891804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201433c2-e0f6-4b12-b7c5-f449de75bf4c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.891804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201433c2-e0f6-4b12-b7c5-f449de75bf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.932342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-201433c2-e0f6-4b12-b7c5-f449de75bf4c None None] MFA Rules not processed for user `f6f461c1133042a19b8c33bfe7e9dd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:57.934928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-201433c2-e0f6-4b12-b7c5-f449de75bf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:57.958621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535999b-c507-4190-8899-d680f2868586 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:57.963960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:57.965160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:57.965160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:57.965830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:57.977752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:57.979205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:57.992182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 826/1617] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:57.993510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:57.995462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:58.008432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be3b93-10a4-44fa-a03b-4783cee828a3 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.011699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 792/1618] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:58.012977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.013262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.013532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.014249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09704a83-1b2d-4327-a0c4-bb8780b71de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.015020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704a83-1b2d-4327-a0c4-bb8780b71de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.015445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704a83-1b2d-4327-a0c4-bb8780b71de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.016053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09704a83-1b2d-4327-a0c4-bb8780b71de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.029382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09704a83-1b2d-4327-a0c4-bb8780b71de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.030913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09704a83-1b2d-4327-a0c4-bb8780b71de7 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.039980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:58.042433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:58.044858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 827/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:58.046361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b4cf7-fbb2-4580-bbba-5f991697c149 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.046699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b4cf7-fbb2-4580-bbba-5f991697c149 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.047073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b4cf7-fbb2-4580-bbba-5f991697c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.056600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 793/1620] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:58.057798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:58.070940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a369b2-f674-45db-93bf-b2d407d80452 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.077163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.078326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.078814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.079213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] PATH_INFO: `/v3/projects/85d1f4068ad44bfebd6b0d26c12f9520/users/52ce333826454e23b97586413c7417b8/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.081731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d1f4068ad44bfebd6b0d26c12f9520, user_id=52ce333826454e23b97586413c7417b8, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.085998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.097761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-842b4cf7-fbb2-4580-bbba-5f991697c149 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:58.099308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-842b4cf7-fbb2-4580-bbba-5f991697c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:58.108664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 794/1621] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:57:58 2022] PUT /identity/v3/projects/85d1f4068ad44bfebd6b0d26c12f9520/users/52ce333826454e23b97586413c7417b8/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:58.108664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:58.114093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:58.197216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d6368-bcff-47a4-8f45-5d04aae1d7fe admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.202847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f698c-8d59-4123-8efb-013c665377e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.203278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 828/1622] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Sep 13 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:58.203518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f698c-8d59-4123-8efb-013c665377e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.203868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f698c-8d59-4123-8efb-013c665377e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.204281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f698c-8d59-4123-8efb-013c665377e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.206015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798ef4-30cb-4ea4-b921-2cde3f45878e None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.206377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798ef4-30cb-4ea4-b921-2cde3f45878e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.206735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56798ef4-30cb-4ea4-b921-2cde3f45878e None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.208716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 829/1623] 10.222.0.65 () {54 vars in 962 bytes} [Tue Sep 13 19:57:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:57:58.209520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798ef4-30cb-4ea4-b921-2cde3f45878e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:58.223260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56798ef4-30cb-4ea4-b921-2cde3f45878e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.241371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.242135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.242412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.242661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.282896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f698c-8d59-4123-8efb-013c665377e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.284447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f698c-8d59-4123-8efb-013c665377e1 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.302272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 795/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:58.304421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca05a7c-48c2-46e9-bc5f-61d7cff4f49e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.304734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca05a7c-48c2-46e9-bc5f-61d7cff4f49e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.305038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca05a7c-48c2-46e9-bc5f-61d7cff4f49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.310047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:58.343615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9ca05a7c-48c2-46e9-bc5f-61d7cff4f49e None None] MFA Rules not processed for user `52ce333826454e23b97586413c7417b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:58.345389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ca05a7c-48c2-46e9-bc5f-61d7cff4f49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:58.383954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.385512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.397612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 830/1625] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:58.398756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:58.414883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdeec-87a7-4f59-ac6d-65cf8194222c service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.426268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.427004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.427940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.428218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.444177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 796/1626] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:58.445689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.445975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.446248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.492692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:58.493711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:58.506332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 797/1627] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Sep 13 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:58.507408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:58.540577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.542789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.551829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:58.558452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 831/1628] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:58.559592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:58.574553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e6bb-a260-4134-b30a-cd23d528747f service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.582609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49439b5e-a9d7-4e39-b98b-606522f252fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.583641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439b5e-a9d7-4e39-b98b-606522f252fd service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.583978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439b5e-a9d7-4e39-b98b-606522f252fd service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.584237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49439b5e-a9d7-4e39-b98b-606522f252fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.589065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f16e87-dfa9-42da-b418-c45b07554628 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:58.596081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85163e1b-2d35-4d1c-af46-71b8bc817b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:58.596834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163e1b-2d35-4d1c-af46-71b8bc817b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.597716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163e1b-2d35-4d1c-af46-71b8bc817b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.597999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85163e1b-2d35-4d1c-af46-71b8bc817b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.613386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85163e1b-2d35-4d1c-af46-71b8bc817b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.615619 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85163e1b-2d35-4d1c-af46-71b8bc817b7e service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.644689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 798/1629] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:58.666740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439b5e-a9d7-4e39-b98b-606522f252fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:58.669758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49439b5e-a9d7-4e39-b98b-606522f252fd service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:58.708592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 832/1630] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:58.922597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8540e-e850-4cc1-a184-6cbe6d332be5 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.923042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8540e-e850-4cc1-a184-6cbe6d332be5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.923546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8540e-e850-4cc1-a184-6cbe6d332be5 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.925190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 799/1631] 10.222.0.65 () {54 vars in 912 bytes} [Tue Sep 13 19:57:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:57:58.932142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39c2d-8c07-4fb5-8eec-ee904b821211 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:58.932660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39c2d-8c07-4fb5-8eec-ee904b821211 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:58.933187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39c2d-8c07-4fb5-8eec-ee904b821211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:58.966644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4cb39c2d-8c07-4fb5-8eec-ee904b821211 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:58.968048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4cb39c2d-8c07-4fb5-8eec-ee904b821211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:59.000025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 833/1632] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 19:57:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:59.015196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8540e-e850-4cc1-a184-6cbe6d332be5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:59.045432 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8540e-e850-4cc1-a184-6cbe6d332be5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:59.062779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a800ac3-0b65-41c1-932c-ea488f30dac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:59.065051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800ac3-0b65-41c1-932c-ea488f30dac6 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:59.065514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800ac3-0b65-41c1-932c-ea488f30dac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:59.066127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a800ac3-0b65-41c1-932c-ea488f30dac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:59.096317 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a800ac3-0b65-41c1-932c-ea488f30dac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:59.100175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a800ac3-0b65-41c1-932c-ea488f30dac6 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:59.138637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 800/1633] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:59.526398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ae23-bb88-4393-a853-00d0fbdf1966 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:59.531560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ae23-bb88-4393-a853-00d0fbdf1966 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:59.533315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ae23-bb88-4393-a853-00d0fbdf1966 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:59.538792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 834/1634] 10.222.0.65 () {54 vars in 912 bytes} [Tue Sep 13 19:57:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:57:59.545952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:59.545952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:59.545952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:59.579465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:57:59.580551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:57:59.633753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 801/1635] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:57:59.659085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149ae23-bb88-4393-a853-00d0fbdf1966 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:59.667640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:57:59.685219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bee2a-15d4-4cb4-b04e-5b071d210e3b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:59.690107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149ae23-bb88-4393-a853-00d0fbdf1966 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:57:59.699482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e7db3-6aa9-4712-9a2d-7b6ce90906e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:59.700133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7db3-6aa9-4712-9a2d-7b6ce90906e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:59.700414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7db3-6aa9-4712-9a2d-7b6ce90906e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:59.700749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e7db3-6aa9-4712-9a2d-7b6ce90906e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:59.701946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:57:59.703755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:59.704319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:59.704841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] PATH_INFO: `/v3/users/4a622e55c09341c788ad6335b592279d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:57:59.710314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a622e55c09341c788ad6335b592279d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:59.716383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:59.721452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7db3-6aa9-4712-9a2d-7b6ce90906e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:57:59.722932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e7db3-6aa9-4712-9a2d-7b6ce90906e1 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:57:59.751414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 802/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:57:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:57:59.843512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a622e55c09341c788ad6335b592279d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:57:59.872070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a622e55c09341c788ad6335b592279d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:57:59.872850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a622e55c09341c788ad6335b592279d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:57:59.874839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a622e55c09341c788ad6335b592279d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:57:59.876145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:59.896880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a622e55c09341c788ad6335b592279d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:57:59.966773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 835/1637] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:57:59 2022] DELETE /identity/v3/users/4a622e55c09341c788ad6335b592279d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:57:59.967260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:57:59.967545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:57:59.967824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:00.003460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:00.004733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:00.146513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:00.148777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:00.177607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 803/1638] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:00.221082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:00.223203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:00.414912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1feaf-14fe-4f58-8d2b-d6b265c4699f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:00.445345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:00.446113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:00.446396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:00.447083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] PATH_INFO: `/v3/users/f6f461c1133042a19b8c33bfe7e9dd6a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:00.458702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f461c1133042a19b8c33bfe7e9dd6a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:00.463760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:00.477709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff469d8-12a8-42d0-990e-a3f13fdd6455 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:00.488262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d848b4-7812-4c98-a55b-0f3ca9a3b9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:00.489400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d848b4-7812-4c98-a55b-0f3ca9a3b9af service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:00.489856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d848b4-7812-4c98-a55b-0f3ca9a3b9af service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:00.490286 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d848b4-7812-4c98-a55b-0f3ca9a3b9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:00.512386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d848b4-7812-4c98-a55b-0f3ca9a3b9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:00.514148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d848b4-7812-4c98-a55b-0f3ca9a3b9af service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:00.531401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 804/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:00.567739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f461c1133042a19b8c33bfe7e9dd6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:00.580574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f461c1133042a19b8c33bfe7e9dd6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:00.585050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f461c1133042a19b8c33bfe7e9dd6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:00.592499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f461c1133042a19b8c33bfe7e9dd6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:00.602273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f461c1133042a19b8c33bfe7e9dd6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:00.637371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 836/1640] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:00 2022] DELETE /identity/v3/users/f6f461c1133042a19b8c33bfe7e9dd6a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:00.642036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:00.643167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:00.643666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:00.667635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:00.669062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:00.715982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:00.747091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 805/1641] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:00.805256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:00.807323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:00.901570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565b93d-ec72-4ec9-b16b-240522b4d5a5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:00.906263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:00.906899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:00.907223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:00.907503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:00.917890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:00.925642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:00.929875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:00.948427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 837/1642] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:02.440006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:02.441739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:02.460226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fc83-4727-4038-9946-58692c6adf7e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:02.467661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:02.468554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:02.469175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:02.469559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] PATH_INFO: `/v3/projects/aeb76a6d5c5c48c9b8f5feffaaa8b324` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:02.473355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb76a6d5c5c48c9b8f5feffaaa8b324)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:02.475691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:02.582580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb76a6d5c5c48c9b8f5feffaaa8b324', 'request_id': 'req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.592047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb76a6d5c5c48c9b8f5feffaaa8b324', 'request_id': 'req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.605133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb76a6d5c5c48c9b8f5feffaaa8b324', 'request_id': 'req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.636338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] The token cache is being invalidate because project aeb76a6d5c5c48c9b8f5feffaaa8b324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:02.637748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.638874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.641195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 806/1643] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:02 2022] DELETE /identity/v3/projects/aeb76a6d5c5c48c9b8f5feffaaa8b324 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:02.646877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:02.660232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84dff-430d-400a-b8be-182f69a4005a service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:02.755787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:02.756885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:02.757461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:02.757884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] PATH_INFO: `/v3/users/52ce333826454e23b97586413c7417b8` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:02.759365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ce333826454e23b97586413c7417b8)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:02.761847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:02.845287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ce333826454e23b97586413c7417b8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.877088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ce333826454e23b97586413c7417b8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.878028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ce333826454e23b97586413c7417b8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.878720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ce333826454e23b97586413c7417b8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.889584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2fb3f859-30e3-44a4-9cc3-68653deb67a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ce333826454e23b97586413c7417b8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:02.931965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:02.933885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:02.952889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 838/1644] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:02 2022] DELETE /identity/v3/users/52ce333826454e23b97586413c7417b8 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:02.957100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77816fc-ccb6-47d7-8ac3-697a79b0ae08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:03.062204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:03.062878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:03.065024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:03.065324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] PATH_INFO: `/v3/projects/63512bf9bbaf4d70b704f605f11165be` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:03.068338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=63512bf9bbaf4d70b704f605f11165be)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:03.074616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:03.160519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63512bf9bbaf4d70b704f605f11165be', 'request_id': 'req-b5332665-17e9-4bc6-990c-dd68e66e08cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:03.174293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63512bf9bbaf4d70b704f605f11165be', 'request_id': 'req-b5332665-17e9-4bc6-990c-dd68e66e08cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:03.193900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63512bf9bbaf4d70b704f605f11165be', 'request_id': 'req-b5332665-17e9-4bc6-990c-dd68e66e08cf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:03.207800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:03.213838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] The token cache is being invalidate because project 63512bf9bbaf4d70b704f605f11165be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:03.214143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:03.215124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5332665-17e9-4bc6-990c-dd68e66e08cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:03.223123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 807/1645] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:02 2022] DELETE /identity/v3/projects/63512bf9bbaf4d70b704f605f11165be => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:03.227277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:03.227569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:03.227923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:03.268497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:03.270328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:03.430531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 839/1646] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:03.431991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:03.431991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:03.432281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:03.476996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:03.485886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:03.511390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 808/1647] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:03.515682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:03.567222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6cc25-868a-4cf4-9d29-5f30498b7f93 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:03.582355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:03.582701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:03.582985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:03.583986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:03.584559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:03.586143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:03.590503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:03.642114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:03.649608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 840/1648] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:58:03.654281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:03.684932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46108e-8761-40e2-b718-6ac89c4de5f3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:03.752559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:03.757325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:03.757790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:03.758260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:03.759671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:03.763598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:03.836116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 809/1649] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:03 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:03.842284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:03.875848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5fe86-9882-44f3-93de-8a9efe0c9ca1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:04.089347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:04.089992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.090814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.090814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.091257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:04.093305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:04.179992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 841/1650] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:03 2022] POST /identity/v3/users => generated 303 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:04.184220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:04.197309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81049b96-94ec-4a3a-9a1c-3b9249b900ea admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:04.217383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:04.229518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.229996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.230442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.231158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:04.233954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:04.266203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 810/1651] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:04.270462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:04.282864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688bbfb-49bf-4060-955d-984f0fd61fa0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:04.303767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:04.304799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.305230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.305640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.306580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:04.308416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:04.328722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 842/1652] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:04.333133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:04.346763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc50c58-1f34-4754-89ac-b86b8003d0e9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:04.352460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1404de-cc18-4a80-b790-0d4971acb0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:04.353500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1404de-cc18-4a80-b790-0d4971acb0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.353943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1404de-cc18-4a80-b790-0d4971acb0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.354343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1404de-cc18-4a80-b790-0d4971acb0f0 admin admin] PATH_INFO: `/v3/projects/f8e6aa85ab4845a6a6333f415836c604/users/09e8d4cdf4e04a54a298e54241a3b29a/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.380378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1404de-cc18-4a80-b790-0d4971acb0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e6aa85ab4845a6a6333f415836c604, user_id=09e8d4cdf4e04a54a298e54241a3b29a, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:04.385010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1404de-cc18-4a80-b790-0d4971acb0f0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:04.406258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:04.408227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:04.424389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 811/1653] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:04 2022] PUT /identity/v3/projects/f8e6aa85ab4845a6a6333f415836c604/users/09e8d4cdf4e04a54a298e54241a3b29a/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:04.443679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.445301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae1503-ce76-4a81-8f06-f8403f6098e7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:04.445496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.446334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.541589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] MFA Rules not processed for user `09e8d4cdf4e04a54a298e54241a3b29a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:04.543272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:04.616924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:04.619015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.619754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.620974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] PATH_INFO: `/v3/projects/85d1f4068ad44bfebd6b0d26c12f9520` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.622496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d1f4068ad44bfebd6b0d26c12f9520)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:04.623625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: WARNING py.warnings [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:04.623625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: warnings.warn(msg) Sep 13 19:58:04.623625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: Sep 13 19:58:04.625282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:04.713928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 812/1654] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:04.715392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:04.740048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbab74-46d0-4653-80ae-6f822d164b79 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:04.763501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d1f4068ad44bfebd6b0d26c12f9520', 'request_id': 'req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:04.810785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d1f4068ad44bfebd6b0d26c12f9520', 'request_id': 'req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:04.835873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d1f4068ad44bfebd6b0d26c12f9520', 'request_id': 'req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:04.870633 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] The token cache is being invalidate because project 85d1f4068ad44bfebd6b0d26c12f9520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:04.870633 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:04.876675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7814030b-b2e6-4f4a-97b2-568dc7e3e1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:04.886004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 843/1655] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:04 2022] DELETE /identity/v3/projects/85d1f4068ad44bfebd6b0d26c12f9520 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:04.891571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd58f-8f2a-42ef-bd69-87830e41fc2a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.892229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd58f-8f2a-42ef-bd69-87830e41fc2a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.892718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dd58f-8f2a-42ef-bd69-87830e41fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.946158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:04.947148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:04.947879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:04.947879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:04.953000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:04.956265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:04.987538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-822dd58f-8f2a-42ef-bd69-87830e41fc2a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:04.998323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-822dd58f-8f2a-42ef-bd69-87830e41fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:05.021636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 813/1656] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:04 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:05.022772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.027342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:05.029516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 844/1657] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:05.043210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.053604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.054865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.077185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:05.079219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:05.135969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:05.154541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:05.254435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7eb06-802c-4527-9b48-c7a7bb0c89a7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.277444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.279205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.280282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.280558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.281277 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.286818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.364439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 814/1658] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:05 2022] POST /identity/v3/users => generated 309 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:05.365827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.396917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 845/1659] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:05.400528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db1a28-4e7d-4f89-bef1-492336fa3605 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.401930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.430798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31a2ac-e41d-4ae7-bc77-e8b26f6d59fd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.432830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.434873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.437783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.438828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.439312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.439785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.440712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:05.441219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.443069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.445136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.445666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.446394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.454411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.463755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 846/1660] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:05.464834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.468666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:05.469597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 815/1661] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:05.470681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.483340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c7ded-0391-4720-ac59-b5af03eaf979 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.489896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405e59e-6c56-4384-94ad-0626d95bfc09 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.496064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.497072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.497504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.498141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] PATH_INFO: `/v3/users/70bd24d26f2b4eeb87442d969858fb85` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.500644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bd24d26f2b4eeb87442d969858fb85)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.502454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.502829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.503330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.503767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.504597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.506917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.507523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.550737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 816/1662] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:05 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:05.551937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.657434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c99e7-60fe-4ba1-898b-6a4c0b962a78 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.664203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.664203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.664599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.664691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] PATH_INFO: `/v3/projects/1007433b75604b1fb3d0831e67818dca/users/dfeb5b862a4046719a0c48d19498b2f9/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.668667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bd24d26f2b4eeb87442d969858fb85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:05.693332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bd24d26f2b4eeb87442d969858fb85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:05.694051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bd24d26f2b4eeb87442d969858fb85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:05.695184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bd24d26f2b4eeb87442d969858fb85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:05.705973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1007433b75604b1fb3d0831e67818dca, user_id=dfeb5b862a4046719a0c48d19498b2f9, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.708841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.709271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bd24d26f2b4eeb87442d969858fb85'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:05.740103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 817/1663] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:05 2022] PUT /identity/v3/projects/1007433b75604b1fb3d0831e67818dca/users/dfeb5b862a4046719a0c48d19498b2f9/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:05.742087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.746905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:05.756711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 847/1664] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:05 2022] DELETE /identity/v3/users/70bd24d26f2b4eeb87442d969858fb85 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:05.758045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:05.759729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:05.862089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:05.888307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3fa5-1ec2-4e82-84d9-48feaba486ec admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.943032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0baf61-6cdd-4c9b-bd04-fc4b67835449 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:05.957094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84447d46-f99e-4ba4-b681-a825445f58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:05.957731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84447d46-f99e-4ba4-b681-a825445f58c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.958015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84447d46-f99e-4ba4-b681-a825445f58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.958865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84447d46-f99e-4ba4-b681-a825445f58c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:05.959552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84447d46-f99e-4ba4-b681-a825445f58c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:05.965342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84447d46-f99e-4ba4-b681-a825445f58c3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:05.972049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:05.995116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 848/1665] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:05.996703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:05.998321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:05.998608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.006606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.008365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.008915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.009653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.011877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:06.014125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:06.049529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:06.050829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:06.075869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 849/1666] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:06.079418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 818/1667] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:05 2022] POST /identity/v3/users => generated 279 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:06.079510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.083347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.096482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e182dbb-99de-40e4-9f98-7540f9f66e06 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:06.097698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814bc13-1ba9-4d23-8060-ab3fd4c6a0e2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:06.109208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.109909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.110184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.110879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] PATH_INFO: `/v3/projects/1007433b75604b1fb3d0831e67818dca/users/dfeb5b862a4046719a0c48d19498b2f9/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.113011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.113640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.113920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.114187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.114852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:06.116487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:06.118404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1007433b75604b1fb3d0831e67818dca, user_id=dfeb5b862a4046719a0c48d19498b2f9, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:06.121013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:06.140168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 819/1668] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:06.141113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.144898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 850/1669] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:06 2022] PUT /identity/v3/projects/1007433b75604b1fb3d0831e67818dca/users/dfeb5b862a4046719a0c48d19498b2f9/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:06.145578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.155302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:06.295188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86513f-aad6-47fa-92ea-631397ae0a38 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:06.308160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17cc3-644c-43cd-8bfa-e4e8d2aa078f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:06.321400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31d0ab-da19-4120-94cf-0958144e5092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.321864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d0ab-da19-4120-94cf-0958144e5092 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.322210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d0ab-da19-4120-94cf-0958144e5092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.322411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d0ab-da19-4120-94cf-0958144e5092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.328504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d0ab-da19-4120-94cf-0958144e5092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:06.330180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31d0ab-da19-4120-94cf-0958144e5092 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:06.358297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 851/1670] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:06.359671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.359952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.360221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.376742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.376969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.377239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.377559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.403035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:06.404711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:06.426952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 820/1671] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:06.427962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.433650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] MFA Rules not processed for user `dfeb5b862a4046719a0c48d19498b2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:06.435318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:06.441957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb4fe-1407-420a-84d8-ab8267eb8826 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:06.449638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7b76f-0d5b-4eab-9aaa-c221fa20610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.450477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b76f-0d5b-4eab-9aaa-c221fa20610c admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.450915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b76f-0d5b-4eab-9aaa-c221fa20610c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.451320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7b76f-0d5b-4eab-9aaa-c221fa20610c admin admin] PATH_INFO: `/v3/projects/547a8ffc8b0c4a24af98e7b952f892b8/users/29f37148210d4e66b2aa2e434fc4ebf5/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.476915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b76f-0d5b-4eab-9aaa-c221fa20610c admin admin] RBAC: Authorizing `identity:create_grant(project_id=547a8ffc8b0c4a24af98e7b952f892b8, user_id=29f37148210d4e66b2aa2e434fc4ebf5, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:06.480212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7b76f-0d5b-4eab-9aaa-c221fa20610c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:06.509673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 821/1672] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:06 2022] PUT /identity/v3/projects/547a8ffc8b0c4a24af98e7b952f892b8/users/29f37148210d4e66b2aa2e434fc4ebf5/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:06.520456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.520792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.521301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:06.573897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:06.602193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 852/1673] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:06.604743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] MFA Rules not processed for user `29f37148210d4e66b2aa2e434fc4ebf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:06.606626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:06.609321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.612508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:06.794502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe9602-71a4-47e6-a397-71b0f8cf0fba None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:06.822248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:06.899066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 822/1674] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:06.905052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:06.935267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:06.936064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:06.936441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:06.936863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.034839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e88c7-6abe-48f4-a90b-c1a3c208208f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.053934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.056931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.058252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.058252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.058252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.060935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.112603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.115708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.116985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 823/1675] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:06 2022] POST /identity/v3/projects => generated 357 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:07.122154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:07.149594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 853/1676] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:06 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:07.291665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965619f-8e7d-4dc1-b775-9c771431e09a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.303590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.304404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.305391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.307319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.308406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.315145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.365750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 824/1677] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:07 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:07.370039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:07.383935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33171de3-c5cc-4784-ad75-202b3aac43d3 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.399269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.405137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.407878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.408697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.409521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.414733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.437938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:07.447690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 854/1678] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:07.454289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6071514-a527-4f54-a7bf-6ddd848e7ff1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.455625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:07.471491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec36b7a-ee2f-4e83-a73f-c9a5c57339e5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.480120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.480626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.481502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.481930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.482151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.482412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.482728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] PATH_INFO: `/v3/users/09e8d4cdf4e04a54a298e54241a3b29a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.482844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] PATH_INFO: `/v3/projects/6178c3a5329f4f12a52374b43728a022/users/e7b3e8995d0f4114b1cb229da8d12089/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.491307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e8d4cdf4e04a54a298e54241a3b29a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.492583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: WARNING py.warnings [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:07.492583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: warnings.warn(msg) Sep 13 19:58:07.492583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: Sep 13 19:58:07.494198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.510878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:07.529238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6178c3a5329f4f12a52374b43728a022, user_id=e7b3e8995d0f4114b1cb229da8d12089, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.537441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.587282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 855/1679] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:07 2022] PUT /identity/v3/projects/6178c3a5329f4f12a52374b43728a022/users/e7b3e8995d0f4114b1cb229da8d12089/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:07.593411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:07.707305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e8d4cdf4e04a54a298e54241a3b29a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:07.733638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e8d4cdf4e04a54a298e54241a3b29a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:07.734494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e8d4cdf4e04a54a298e54241a3b29a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:07.735310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e8d4cdf4e04a54a298e54241a3b29a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:07.758280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e8d4cdf4e04a54a298e54241a3b29a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:07.787571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b4c0e-491b-4a8b-9a5d-15d7758d6260 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.803681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8f434-282a-4f32-be7a-6796001b18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.804622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8f434-282a-4f32-be7a-6796001b18b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.805013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8f434-282a-4f32-be7a-6796001b18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.805409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8f434-282a-4f32-be7a-6796001b18b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.806143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8f434-282a-4f32-be7a-6796001b18b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:07.812927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8f434-282a-4f32-be7a-6796001b18b3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:07.820997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 825/1680] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:07 2022] DELETE /identity/v3/users/09e8d4cdf4e04a54a298e54241a3b29a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:07.820997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:07.826194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:07.843532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 856/1681] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:07.845256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.845999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.850555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.900582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:07.906532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:07.952559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:07.978038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c5f81-948b-40ad-84b8-5b6c96aa9285 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:07.989339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:07.992744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:07.993798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:07.993798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] PATH_INFO: `/v3/projects/c1c0e1368e334ecc960440e6af5a3a0b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:07.997685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c0e1368e334ecc960440e6af5a3a0b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:08.001488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:08.081313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 857/1682] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:08.082342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:08.084050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.114940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d62b8-de95-4424-b311-dbd66e50170b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:08.124736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c0e1368e334ecc960440e6af5a3a0b', 'request_id': 'req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:08.146560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c0e1368e334ecc960440e6af5a3a0b', 'request_id': 'req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:08.169346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c0e1368e334ecc960440e6af5a3a0b', 'request_id': 'req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:08.185515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] The token cache is being invalidate because project c1c0e1368e334ecc960440e6af5a3a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:08.185819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:08.187930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:08.195172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 826/1683] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:07 2022] DELETE /identity/v3/projects/c1c0e1368e334ecc960440e6af5a3a0b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:08.195172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:08.198836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.236244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:08.263564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40e7e-5570-4f95-a5e6-0033f043bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:08.264331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40e7e-5570-4f95-a5e6-0033f043bc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.264629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40e7e-5570-4f95-a5e6-0033f043bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.264909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40e7e-5570-4f95-a5e6-0033f043bc49 admin admin] PATH_INFO: `/v3/projects/6178c3a5329f4f12a52374b43728a022/users/e7b3e8995d0f4114b1cb229da8d12089/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.267035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40e7e-5570-4f95-a5e6-0033f043bc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6178c3a5329f4f12a52374b43728a022, user_id=e7b3e8995d0f4114b1cb229da8d12089, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:08.269736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40e7e-5570-4f95-a5e6-0033f043bc49 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:08.292122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 858/1684] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:08 2022] PUT /identity/v3/projects/6178c3a5329f4f12a52374b43728a022/users/e7b3e8995d0f4114b1cb229da8d12089/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:08.294223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceef73-cf40-43fc-b96d-572caaaee897 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.294511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceef73-cf40-43fc-b96d-572caaaee897 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.294791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceef73-cf40-43fc-b96d-572caaaee897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.323015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7fde4-7100-4bbb-a45f-581d0a0b5c2d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:08.334308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-65ceef73-cf40-43fc-b96d-572caaaee897 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:08.335782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-65ceef73-cf40-43fc-b96d-572caaaee897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.429293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:08.431080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.431358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.431629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.445443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.490118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 859/1685] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:08.492519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.495078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.495364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.555468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] MFA Rules not processed for user `e7b3e8995d0f4114b1cb229da8d12089`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:08.556878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.593583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:08.595121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac3a71-f51c-44fa-aa7a-b4b6347ab5d3 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:08.617178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 827/1686] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:08.619925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.620210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.620562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.665729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:08.668215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:08.668596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.689434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 828/1687] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:08.695144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:08.716270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92deda5-8733-410a-ba1e-97fdcea29fdf None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:08.718435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 860/1688] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:08.731534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:08.733183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:08.734643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:08.741371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.741681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.741959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.749398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:08.749776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:08.754218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:08.807451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 829/1689] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:08.813223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:08.839435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe89fb-764f-4d86-b820-956b38b41b4d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:08.851320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:08.852290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.853998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.854279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.856907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:08.863554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:08.903100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4447dd-b623-4f07-aedb-e356ce87f456 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:08.907885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:08.908982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:08.909380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:08.909703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:08.925982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 830/1690] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:08 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:08.927615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:08.945767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:08.949230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:08.973607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 861/1691] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:09.003678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:09.038569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf8ba7-31d6-49c3-8400-f883f6231900 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:09.051599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:09.052680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:09.053285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:09.054128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:09.055379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:09.058720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:09.100102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 831/1692] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:08 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:09.105445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:09.141502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:09.154179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6339ef8-a8db-4380-85b9-078206341f93 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:09.167746 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:09.170646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:09.171099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:09.171480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:09.174304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:09.177802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:09.206302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 862/1693] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:09.209232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:09.239478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb030e-ddd7-4d81-8aad-e6b2ac50cfeb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:09.252995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:09.255133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:09.257412 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:09.258111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:09.259251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:09.267072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:09.296409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 863/1694] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:09.299237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:09.300205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c792-7e98-4fec-aff3-3988735dbe4b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:09.314603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e907dd-f298-4551-b6ab-910ee49dc0c8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:09.317461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:09.318116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:09.318399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:09.318671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:09.320571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:09.321715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117ac32-5577-441b-b553-fe34588e5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:09.323680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ac32-5577-441b-b553-fe34588e5b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:09.324092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ac32-5577-441b-b553-fe34588e5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:09.324471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ac32-5577-441b-b553-fe34588e5b91 admin admin] PATH_INFO: `/v3/projects/aaf238d6612d469bb109f121a92a8ff9/users/4d77bb0fb91e404c882149ae720a55db/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:09.345302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117ac32-5577-441b-b553-fe34588e5b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf238d6612d469bb109f121a92a8ff9, user_id=4d77bb0fb91e404c882149ae720a55db, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:09.348998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117ac32-5577-441b-b553-fe34588e5b91 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:09.416458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 864/1695] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:09 2022] PUT /identity/v3/projects/aaf238d6612d469bb109f121a92a8ff9/users/4d77bb0fb91e404c882149ae720a55db/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:09.432286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:09.432576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:09.433494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:09.485271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:09.486874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:09.507421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 832/1696] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:09.543932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] MFA Rules not processed for user `4d77bb0fb91e404c882149ae720a55db`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:09.545604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:09.712662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 865/1697] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:09.724808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:09.726410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:09.740092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:09.741684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:09.785515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb82c7-c73e-4e28-8d70-545b6030a9b7 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:09.901076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.030815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:10.034128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:10.034128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:10.034128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] PATH_INFO: `/v3/projects/f8e6aa85ab4845a6a6333f415836c604` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:10.052550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e6aa85ab4845a6a6333f415836c604)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:10.060910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:10.067910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeadce-688d-4428-9357-b5a23883150f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:10.097522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:10.098739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:10.113504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:10.114129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:10.152354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:10.165273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:10.173112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:10.191795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e6aa85ab4845a6a6333f415836c604', 'request_id': 'req-5ea75cf6-33be-461b-9509-71ea71048a4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.200286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 866/1698] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:10.213247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e6aa85ab4845a6a6333f415836c604', 'request_id': 'req-5ea75cf6-33be-461b-9509-71ea71048a4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.231938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e6aa85ab4845a6a6333f415836c604', 'request_id': 'req-5ea75cf6-33be-461b-9509-71ea71048a4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.264379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] The token cache is being invalidate because project f8e6aa85ab4845a6a6333f415836c604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:10.264719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.265484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.272259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 833/1699] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:09 2022] DELETE /identity/v3/projects/f8e6aa85ab4845a6a6333f415836c604 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:10.274485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:10.292452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac77f-cfdf-400c-b0ab-9c14009a5bc6 service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:10.455196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:10.455878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:10.456180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:10.456458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] PATH_INFO: `/v3/users/dfeb5b862a4046719a0c48d19498b2f9` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:10.461212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfeb5b862a4046719a0c48d19498b2f9)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:10.466555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:10.615270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfeb5b862a4046719a0c48d19498b2f9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.638925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfeb5b862a4046719a0c48d19498b2f9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.640575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfeb5b862a4046719a0c48d19498b2f9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.641345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfeb5b862a4046719a0c48d19498b2f9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.664546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4cc1a637-584c-486e-a865-4d5ae4d00f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfeb5b862a4046719a0c48d19498b2f9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:10.711164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 867/1700] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:10 2022] DELETE /identity/v3/users/dfeb5b862a4046719a0c48d19498b2f9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:12.130513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:12.132070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:12.159205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75cf6-33be-461b-9509-71ea71048a4d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:12.300124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:12.300844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:12.301119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:12.301385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] PATH_INFO: `/v3/projects/1007433b75604b1fb3d0831e67818dca` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:12.305380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1007433b75604b1fb3d0831e67818dca)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:12.307981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:12.496421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1007433b75604b1fb3d0831e67818dca', 'request_id': 'req-89c3a02e-577e-4137-af5e-3519450c645a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:12.530700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1007433b75604b1fb3d0831e67818dca', 'request_id': 'req-89c3a02e-577e-4137-af5e-3519450c645a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:12.560543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1007433b75604b1fb3d0831e67818dca', 'request_id': 'req-89c3a02e-577e-4137-af5e-3519450c645a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:12.600812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] The token cache is being invalidate because project 1007433b75604b1fb3d0831e67818dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:12.601140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:12.604220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-89c3a02e-577e-4137-af5e-3519450c645a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:12.613028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 834/1701] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:12 2022] DELETE /identity/v3/projects/1007433b75604b1fb3d0831e67818dca => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:12.614845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:12.615322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:12.615419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:12.700208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:12.701535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:12.851750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:12.948408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 868/1702] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:12.955458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:12.956111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:12.956503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.046808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:13.048339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:13.059362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 835/1703] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:13.063337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:13.074911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9359d0-8ed3-4c52-ac7c-970131acd307 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:13.097645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:13.098359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.098656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.098891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.099559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:13.106339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:13.113696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:13.152993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 869/1704] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:58:13.157299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:13.173675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a8cd1-c59c-4fff-bc6b-8ac9ca7d3b40 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:13.182676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:13.183474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.183784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.184075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.184863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:13.191731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:13.267213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 836/1705] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:13 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:13.274507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:13.291319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba052b99-b025-4778-980c-4e3545272fd2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:13.475501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:13.476140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.476429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.478234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.478914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:13.486411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:13.553107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 870/1706] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:13 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:13.557453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:13.571240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bffdac-3276-4783-af34-99f4fdf9aa6e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:13.593687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:13.594227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.594515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.594798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.595450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:13.597189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:13.618606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 837/1707] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:13.621018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:13.640342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54265f1-12c5-4302-a465-dab6bd058990 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:13.651108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66498e3-c378-4279-b57c-88af9a9276a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:13.652304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66498e3-c378-4279-b57c-88af9a9276a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.652762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66498e3-c378-4279-b57c-88af9a9276a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.653196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66498e3-c378-4279-b57c-88af9a9276a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.654013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66498e3-c378-4279-b57c-88af9a9276a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:13.655870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66498e3-c378-4279-b57c-88af9a9276a9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:13.671120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 871/1708] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:13.675012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:13.691660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:13.697359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bfb5d-92de-423e-a2f3-3f09b9a24151 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:13.710257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e06ed-a37c-496c-bd62-d3146d18dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:13.713213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e06ed-a37c-496c-bd62-d3146d18dba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.713686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e06ed-a37c-496c-bd62-d3146d18dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.715306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e06ed-a37c-496c-bd62-d3146d18dba4 admin admin] PATH_INFO: `/v3/projects/324235c6062f47a48ff74f6f238504a8/users/2fd31dfb0e6e4f6b89c91ff9175d4093/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.756883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e06ed-a37c-496c-bd62-d3146d18dba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324235c6062f47a48ff74f6f238504a8, user_id=2fd31dfb0e6e4f6b89c91ff9175d4093, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:13.759905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e06ed-a37c-496c-bd62-d3146d18dba4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:13.791073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 838/1709] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:13 2022] PUT /identity/v3/projects/324235c6062f47a48ff74f6f238504a8/users/2fd31dfb0e6e4f6b89c91ff9175d4093/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:13.802587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.808589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.808945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.809150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.809451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.810448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.915197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] MFA Rules not processed for user `f7356d1144b14a4da1191729e2baafad`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:13.921881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:13.935875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] MFA Rules not processed for user `2fd31dfb0e6e4f6b89c91ff9175d4093`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:13.939135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.073245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 872/1710] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:14.080409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.085214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.161110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:14.165582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 839/1711] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:14.166586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.171051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.238672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266dba-fd5b-4520-b4c6-d4b58a68e3c3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.244265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.245382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.245695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.245966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] PATH_INFO: `/v3/users/4d77bb0fb91e404c882149ae720a55db` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.247217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d77bb0fb91e404c882149ae720a55db)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.249302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.351881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51118-1288-4390-a9b4-0c19c30b9a26 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.370177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d77bb0fb91e404c882149ae720a55db'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:14.384162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.385413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.386243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.386243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.391435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d77bb0fb91e404c882149ae720a55db'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:14.392208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d77bb0fb91e404c882149ae720a55db'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:14.393055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d77bb0fb91e404c882149ae720a55db'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:14.401498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.402717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4bd06e93-7bc9-43ea-be55-1c043970eb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d77bb0fb91e404c882149ae720a55db'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:14.403648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.434739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 840/1712] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:14.436067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.465838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74808745-f33f-4332-a7a6-1a003a5caa40 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.473572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 873/1713] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:14 2022] DELETE /identity/v3/users/4d77bb0fb91e404c882149ae720a55db => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:14.491140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c00a5-2838-4800-a9d1-293de1f40516 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.492990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c00a5-2838-4800-a9d1-293de1f40516 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.493787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c00a5-2838-4800-a9d1-293de1f40516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.553194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3c9c00a5-2838-4800-a9d1-293de1f40516 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:14.554938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3c9c00a5-2838-4800-a9d1-293de1f40516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.663371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:14.697544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.698194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.698558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.698837 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.699497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.727112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.787737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 874/1714] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:14.793584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.798317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.798651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.814064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 841/1715] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/projects => generated 373 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:14.818193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.820377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.927450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] MFA Rules not processed for user `cea89d871eb14900bb3988721446c489`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:14.931210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.999002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e78a0-e0c7-49fa-8297-12ec3065e702 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.012181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.012857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.013136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.013398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.014061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.020004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.096572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.102927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 842/1716] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:15.106950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.114603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.179491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 875/1717] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:15.180382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.218963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4cf58-c206-4e6d-a53d-66e763c8a37f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.232768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946885c-ab10-4d0a-82d3-bd7ef8a1f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.234398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946885c-ab10-4d0a-82d3-bd7ef8a1f158 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.235844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946885c-ab10-4d0a-82d3-bd7ef8a1f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.236299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946885c-ab10-4d0a-82d3-bd7ef8a1f158 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.238747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946885c-ab10-4d0a-82d3-bd7ef8a1f158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.240802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946885c-ab10-4d0a-82d3-bd7ef8a1f158 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.287101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 876/1718] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:15.293146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.294678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.300128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.384480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d5ce-9fe7-4559-89ee-56a22200ddc0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.386363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] MFA Rules not processed for user `cea89d871eb14900bb3988721446c489`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:15.387826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.400544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.405043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 877/1719] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:15.406214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.410667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.410961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.411284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.432912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb47c5-1420-4450-b3d0-dd3dea630aa9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.446925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.447848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.448340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.448929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] PATH_INFO: `/v3/projects/df5ce45967f34cf98c8925aaa4a5e385/users/b91c90ffe4984d719a6d2c7ee9cf9291/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.457821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.459310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.485923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 843/1720] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:15.491322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.492418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5ce45967f34cf98c8925aaa4a5e385, user_id=b91c90ffe4984d719a6d2c7ee9cf9291, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.495150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.514420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.549809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 878/1721] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:15 2022] PUT /identity/v3/projects/df5ce45967f34cf98c8925aaa4a5e385/users/b91c90ffe4984d719a6d2c7ee9cf9291/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:15.553756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.719643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456fdcfc-dd3b-436c-bd99-8fa7fa5ab441 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.738702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e485-4a51-4a26-833b-c8273f56b2a3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.741922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.758529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.759725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.761922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.764556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.765551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.771094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.803400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 879/1722] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:15.804751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.837115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b5ed2-4436-44e9-9bf6-e79b19f497a3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.849916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245770b8-3cf7-4398-8644-b412c64f6a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.853718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245770b8-3cf7-4398-8644-b412c64f6a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.854041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245770b8-3cf7-4398-8644-b412c64f6a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.854374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245770b8-3cf7-4398-8644-b412c64f6a7d admin admin] PATH_INFO: `/v3/projects/df5ce45967f34cf98c8925aaa4a5e385/users/b91c90ffe4984d719a6d2c7ee9cf9291/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.868489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245770b8-3cf7-4398-8644-b412c64f6a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5ce45967f34cf98c8925aaa4a5e385, user_id=b91c90ffe4984d719a6d2c7ee9cf9291, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.877778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245770b8-3cf7-4398-8644-b412c64f6a7d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.894650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 880/1723] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:15 2022] PUT /identity/v3/projects/df5ce45967f34cf98c8925aaa4a5e385/users/b91c90ffe4984d719a6d2c7ee9cf9291/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:15.914480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.915023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.915821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.937327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.939318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.939608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.939918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.995562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] MFA Rules not processed for user `b91c90ffe4984d719a6d2c7ee9cf9291`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:15.999541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.115411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:16.123097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:16.146189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 844/1724] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:16.210449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 881/1725] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:16.223067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:16.224596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.370678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17a3e6-7b8b-481f-8bba-93bb47fa368a service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:16.478970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dfe4f-7516-408c-bb5f-699c2640fb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:16.479798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dfe4f-7516-408c-bb5f-699c2640fb26 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.480165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dfe4f-7516-408c-bb5f-699c2640fb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.480501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dfe4f-7516-408c-bb5f-699c2640fb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.492493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dfe4f-7516-408c-bb5f-699c2640fb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:16.494149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15dfe4f-7516-408c-bb5f-699c2640fb26 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:16.521484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 845/1726] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:16.639808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:16.659640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089fb5c-82bd-4809-acf8-fa3ff6d5bd1f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:16.665050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:16.665961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.666510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.666969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.669389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.678302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:16.769538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:16.771855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:16.797737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 882/1727] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:16.841795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1512c-8c8b-43eb-83a4-522ea24eb697 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.842305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1512c-8c8b-43eb-83a4-522ea24eb697 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.842710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1512c-8c8b-43eb-83a4-522ea24eb697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.909800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:16.999029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:17.000319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-37f1512c-8c8b-43eb-83a4-522ea24eb697 None None] MFA Rules not processed for user `c1ce97baf7cb4711812767724908a984`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:17.001248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.007448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-37f1512c-8c8b-43eb-83a4-522ea24eb697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.186827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da20a1-091f-45af-bc13-48ff3412b0da service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:17.201280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:17.201280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.201659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.202028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] PATH_INFO: `/v3/projects/aaf238d6612d469bb109f121a92a8ff9` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.208744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf238d6612d469bb109f121a92a8ff9)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:17.211205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:17.307115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf238d6612d469bb109f121a92a8ff9', 'request_id': 'req-cb359a2b-c26f-4d57-9cd5-d18656777eaa'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:17.309172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 846/1728] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:17.319666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236ab8-ca6a-4461-b1cd-86f39850ca67 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.320042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236ab8-ca6a-4461-b1cd-86f39850ca67 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.320407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236ab8-ca6a-4461-b1cd-86f39850ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.325533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf238d6612d469bb109f121a92a8ff9', 'request_id': 'req-cb359a2b-c26f-4d57-9cd5-d18656777eaa'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:17.345937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf238d6612d469bb109f121a92a8ff9', 'request_id': 'req-cb359a2b-c26f-4d57-9cd5-d18656777eaa'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:17.370611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] The token cache is being invalidate because project aaf238d6612d469bb109f121a92a8ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:17.371134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:17.372062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-cb359a2b-c26f-4d57-9cd5-d18656777eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:17.374180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 883/1729] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:16 2022] DELETE /identity/v3/projects/aaf238d6612d469bb109f121a92a8ff9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:17.376098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343b39-be27-4b65-a6d6-f9b190a7a994 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.376570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343b39-be27-4b65-a6d6-f9b190a7a994 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.377008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343b39-be27-4b65-a6d6-f9b190a7a994 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.378778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-69236ab8-ca6a-4461-b1cd-86f39850ca67 None None] MFA Rules not processed for user `c1ce97baf7cb4711812767724908a984`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:17.379524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 884/1730] 10.222.0.65 () {54 vars in 912 bytes} [Tue Sep 13 19:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:17.381000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d96b-0563-4e16-b24c-ff6389b046e0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.381422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d96b-0563-4e16-b24c-ff6389b046e0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.381831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d96b-0563-4e16-b24c-ff6389b046e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.385875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-69236ab8-ca6a-4461-b1cd-86f39850ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.408083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9436d96b-0563-4e16-b24c-ff6389b046e0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:17.411512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9436d96b-0563-4e16-b24c-ff6389b046e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.471715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:17.525446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 885/1731] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:17.529221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.532452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.532914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.564459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 847/1732] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:17.566468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.566882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.567291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.610384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:17.612138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.629157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] MFA Rules not processed for user `5dbd68ef35a54c45baada1c45509985c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:17.634336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.652675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 848/1733] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:17.652675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:17.658001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.768876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 886/1734] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:17.769819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:17.795778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e875d20-b63d-41dc-90f2-12358217b506 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:17.801239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:17.801845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.802126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.802501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.803182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:17.803481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:17.806287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:17.831423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f038ae-01a5-4e49-9004-2608e2b3d63c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:17.839970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 887/1735] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:17.840910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:17.846552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:17.847416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.847855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.848226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.852110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.856511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.872128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:17.874667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:17.913138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 849/1736] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:17.913138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:17.913947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a94a6b-9209-4d1d-82cc-0ee2efaffbfd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:17.914343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5750453-e2c2-4726-8466-16bfe4c843ce service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:17.923094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:17.923785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.924069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.924342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.929762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:17.930511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.932670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.933248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:17.935874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:17.938966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:17.965378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:17.969627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:17.980897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:18.005570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 888/1737] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:18.008227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 850/1738] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:17 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:18.013771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:18.047358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942326b3-e4b8-408a-afea-241a93b6b95a service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:18.223060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:18.223705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:18.223977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:18.224245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:18.224916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:18.237459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:18.309168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 889/1739] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:18 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:18.314501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:18.348601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526a5a8-9707-4089-9689-10cf4972d184 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:18.359741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:18.360145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:18.360360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:18.360638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:18.361314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:18.367452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:18.396033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 851/1740] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:18.400028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:18.414694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536998ba-f1eb-4a2c-9419-fc19adec6438 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:18.434323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744265a3-3406-43ce-9ac2-c5bd42b8f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:18.434977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744265a3-3406-43ce-9ac2-c5bd42b8f87c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:18.435259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744265a3-3406-43ce-9ac2-c5bd42b8f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:18.435528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744265a3-3406-43ce-9ac2-c5bd42b8f87c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:18.436187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744265a3-3406-43ce-9ac2-c5bd42b8f87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:18.442844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744265a3-3406-43ce-9ac2-c5bd42b8f87c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:18.477385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 890/1741] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:18.481456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:18.497752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e042-bf09-49ac-a94b-64c773884454 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:18.525638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:18.526210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:18.526498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:18.526895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] PATH_INFO: `/v3/projects/d2363acbcd17425aa2841b7163a76959/users/489c817291c1483183e8dddea7de0a0d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:18.592451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2363acbcd17425aa2841b7163a76959, user_id=489c817291c1483183e8dddea7de0a0d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:18.595212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:18.628668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 852/1742] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:18 2022] PUT /identity/v3/projects/d2363acbcd17425aa2841b7163a76959/users/489c817291c1483183e8dddea7de0a0d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:18.639061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:18.639494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:18.639897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:18.730880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] MFA Rules not processed for user `489c817291c1483183e8dddea7de0a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:18.732748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:18.795409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:19.041058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 891/1743] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:19.045667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:19.202889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa04-3443-4e90-87c7-f2ba796b7e0d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:19.217221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135424-6066-4246-a0b6-6170bbc8dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:19.217892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135424-6066-4246-a0b6-6170bbc8dd10 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.218140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135424-6066-4246-a0b6-6170bbc8dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.218403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135424-6066-4246-a0b6-6170bbc8dd10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.219077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135424-6066-4246-a0b6-6170bbc8dd10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:19.221220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135424-6066-4246-a0b6-6170bbc8dd10 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:19.284629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 853/1744] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:19 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:19.290354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:19.314173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86584-39c4-433f-a238-81cc98f54a35 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.314885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86584-39c4-433f-a238-81cc98f54a35 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.314885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86584-39c4-433f-a238-81cc98f54a35 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.316291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 854/1745] 10.222.0.65 () {54 vars in 912 bytes} [Tue Sep 13 19:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:58:19.325045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.325324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.325592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.334691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc2a68-00ec-4ed6-aae1-a475a61564c7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:19.369404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] MFA Rules not processed for user `5dbd68ef35a54c45baada1c45509985c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:19.371057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:19.515176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:19.515992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.516407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.516835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.517719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:19.520631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:19.569646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 892/1746] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:19 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:19.573439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:19.588137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 855/1747] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 13 19:58:19.591185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02280826-f0ae-487b-8197-fb096b439baf admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:19.606296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:19.606662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.607008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.607293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.608119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:19.610510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:19.618456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:19.618546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:19.631122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c80a9-3be1-43b8-949d-a96cb6e9f9df None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:19.640310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 893/1748] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:19.640757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:19.643398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.643883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.644235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:19.644537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.663941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:19.666989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:19.687424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1806b-0ef4-4468-8eb4-1233021c725b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:19.688027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 856/1749] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:19.706595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ffa51-233f-4170-8e9d-7d53614854bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:19.707296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ffa51-233f-4170-8e9d-7d53614854bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.707575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ffa51-233f-4170-8e9d-7d53614854bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.707852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ffa51-233f-4170-8e9d-7d53614854bc admin admin] PATH_INFO: `/v3/projects/7ba9fb09e5a8447fad37bb9f5500bc98/users/31a647820c3c4152a5af85f7252da9af/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.757545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ffa51-233f-4170-8e9d-7d53614854bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba9fb09e5a8447fad37bb9f5500bc98, user_id=31a647820c3c4152a5af85f7252da9af, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:19.760251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ffa51-233f-4170-8e9d-7d53614854bc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:19.793055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 894/1750] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:19 2022] PUT /identity/v3/projects/7ba9fb09e5a8447fad37bb9f5500bc98/users/31a647820c3c4152a5af85f7252da9af/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:19.797158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:19.823027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698460e0-5455-46b0-81d8-dbf3e8a748eb service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:19.837370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c165a1-b616-4364-bdb4-0a298903ac10 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.837661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c165a1-b616-4364-bdb4-0a298903ac10 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.837930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c165a1-b616-4364-bdb4-0a298903ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.903943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-03c165a1-b616-4364-bdb4-0a298903ac10 None None] MFA Rules not processed for user `cabb7c0ca0714384a8ad38890e12636b`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:19.905776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-03c165a1-b616-4364-bdb4-0a298903ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:19.927377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:19.988627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:19.989280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:19.989556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:19.989820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:19.990468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:19.992109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:20.019294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 857/1751] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:20.020430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:20.048176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a92d0-096d-43d7-ace6-209331eee887 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:20.064967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77298c3c-2590-4e70-9540-074340dcad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:20.065845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298c3c-2590-4e70-9540-074340dcad2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:20.066222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298c3c-2590-4e70-9540-074340dcad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:20.066320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77298c3c-2590-4e70-9540-074340dcad2d admin admin] PATH_INFO: `/v3/projects/7ba9fb09e5a8447fad37bb9f5500bc98/users/31a647820c3c4152a5af85f7252da9af/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:20.081577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77298c3c-2590-4e70-9540-074340dcad2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba9fb09e5a8447fad37bb9f5500bc98, user_id=31a647820c3c4152a5af85f7252da9af, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:20.084500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77298c3c-2590-4e70-9540-074340dcad2d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:20.087484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:20.101830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 895/1752] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:20.152348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 858/1753] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:20 2022] PUT /identity/v3/projects/7ba9fb09e5a8447fad37bb9f5500bc98/users/31a647820c3c4152a5af85f7252da9af/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:20.152953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:20.153384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:20.153982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:20.191343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:20.195877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:20.195877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:20.250986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] MFA Rules not processed for user `31a647820c3c4152a5af85f7252da9af`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:20.251186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] MFA Rules not processed for user `f7356d1144b14a4da1191729e2baafad`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:20.252380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:20.254852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:20.392553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 896/1754] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:20.393805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:20.400734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:20.450343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 859/1755] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:20.452820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:20.455194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:20.675945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20feeb-3ed4-4933-acb4-8ede1bef716b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:20.696383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d96d1-5119-457e-b16c-f312369bb626 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:20.702226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:20.703359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:20.703785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:20.704198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:20.708587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:20.713402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:20.715744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:20.716450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:20.717165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:20.757678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:20.760259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:20.784600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:20.791647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:20.807109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 897/1756] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:20.808157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:20.813619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:20.852337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 860/1757] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:21.077901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0d04c-dd0d-4a39-92a3-93ac95976194 service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:21.089828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:21.094104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:21.102778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b4ac4-271a-480d-a23e-ddaab9bea01e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:21.104250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4ac4-271a-480d-a23e-ddaab9bea01e service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:21.105253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4ac4-271a-480d-a23e-ddaab9bea01e service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:21.107116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4ac4-271a-480d-a23e-ddaab9bea01e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:21.135095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a052e3f-31a1-470c-b1f2-13859508c49f service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:21.140701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0232150-1b43-4356-8d92-a741978e45ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:21.148370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232150-1b43-4356-8d92-a741978e45ea service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:21.148862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232150-1b43-4356-8d92-a741978e45ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:21.149156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0232150-1b43-4356-8d92-a741978e45ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:21.157140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:21.355712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0232150-1b43-4356-8d92-a741978e45ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:21.359825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0232150-1b43-4356-8d92-a741978e45ea service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:21.397533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b4ac4-271a-480d-a23e-ddaab9bea01e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:21.399588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b4ac4-271a-480d-a23e-ddaab9bea01e service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:21.414235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 861/1758] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:21.415793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:21.416648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:21.416648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:21.427719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 898/1759] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:21.538714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:21.547916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] MFA Rules not processed for user `285df012f70e4176ac99f05cd8271b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:21.549846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:21.884957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 862/1760] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:21.965469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638565e-6333-4741-97d2-4146e5e4cd8c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:21.965751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638565e-6333-4741-97d2-4146e5e4cd8c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:21.966206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638565e-6333-4741-97d2-4146e5e4cd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:22.025845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a638565e-6333-4741-97d2-4146e5e4cd8c None None] MFA Rules not processed for user `c1ce97baf7cb4711812767724908a984`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:22.031633 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a638565e-6333-4741-97d2-4146e5e4cd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:22.271399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:22.301561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a95450-5ff8-4f4a-9e37-fad2790dbfa6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:22.343737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:22.344385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:22.344675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:22.344932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:22.355838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 899/1761] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:22.418776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:22.429990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:22.471930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 863/1762] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:26.522747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16edc10-38ea-4f2f-885f-3e0eea17c049 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:26.523787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16edc10-38ea-4f2f-885f-3e0eea17c049 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:26.524270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16edc10-38ea-4f2f-885f-3e0eea17c049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:26.746783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c16edc10-38ea-4f2f-885f-3e0eea17c049 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:26.752005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c16edc10-38ea-4f2f-885f-3e0eea17c049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:27.016691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 900/1763] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 19:58:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:27.403397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:27.405494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:27.679072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634cabc-e455-4b10-914e-dac668b53652 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:27.704112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c12bc6-2b73-4987-b148-11e86d81ef6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:27.705778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12bc6-2b73-4987-b148-11e86d81ef6e service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:27.706190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12bc6-2b73-4987-b148-11e86d81ef6e service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:27.706593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c12bc6-2b73-4987-b148-11e86d81ef6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:27.728409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c12bc6-2b73-4987-b148-11e86d81ef6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:27.732153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c12bc6-2b73-4987-b148-11e86d81ef6e service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:27.773979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 864/1764] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 19:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:58:29.342875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:29.343452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:29.343613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:29.390293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] MFA Rules not processed for user `cabb7c0ca0714384a8ad38890e12636b`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:29.391720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:29.412485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 901/1765] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:29.572530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe9ca-21a4-4e92-8f8c-3f2d52f1f88c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:29.573125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe9ca-21a4-4e92-8f8c-3f2d52f1f88c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:29.573125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9fe9ca-21a4-4e92-8f8c-3f2d52f1f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:29.678348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cc9fe9ca-21a4-4e92-8f8c-3f2d52f1f88c None None] MFA Rules not processed for user `5dbd68ef35a54c45baada1c45509985c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:29.688450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cc9fe9ca-21a4-4e92-8f8c-3f2d52f1f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:29.953612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 865/1766] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Sep 13 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:30.115744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:30.129528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc651e9-79ea-4c27-9428-7aa5400b5742 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:30.156483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:30.157492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:30.158126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:30.158556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:30.190085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:30.192035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:30.246538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 902/1767] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:32.541671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:32.541671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:32.541671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:32.614951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] MFA Rules not processed for user `285df012f70e4176ac99f05cd8271b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:32.616332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:32.707554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 866/1768] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:33.128642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:33.170535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:33.269577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:33.271337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:33.276935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:33.372493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb6d89-2b2d-4e07-8a94-a243b4515b62 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:33.403774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:33.404479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.406809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.408280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] PATH_INFO: `/v3/users/489c817291c1483183e8dddea7de0a0d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.423907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=489c817291c1483183e8dddea7de0a0d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:33.429693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:33.450096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80972d3b-043d-43ad-bb89-77e12f66ea90 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:33.469243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:33.470437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.473009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.473521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] PATH_INFO: `/v3/users/29f37148210d4e66b2aa2e434fc4ebf5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.476721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f37148210d4e66b2aa2e434fc4ebf5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:33.478942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:33.587419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f37148210d4e66b2aa2e434fc4ebf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.601742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f37148210d4e66b2aa2e434fc4ebf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.602762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f37148210d4e66b2aa2e434fc4ebf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.603755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f37148210d4e66b2aa2e434fc4ebf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.608188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489c817291c1483183e8dddea7de0a0d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.621678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fd10f8c1-3473-4a2b-9959-fb0b28b79c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f37148210d4e66b2aa2e434fc4ebf5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.650017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489c817291c1483183e8dddea7de0a0d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.650254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489c817291c1483183e8dddea7de0a0d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.654077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489c817291c1483183e8dddea7de0a0d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.680077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 867/1769] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:33 2022] DELETE /identity/v3/users/29f37148210d4e66b2aa2e434fc4ebf5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:33.685626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e449a2e-9b3f-4025-bfeb-2e6013ca7958 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.686096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e449a2e-9b3f-4025-bfeb-2e6013ca7958 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.686464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e449a2e-9b3f-4025-bfeb-2e6013ca7958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.697246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f2979c95-4cc6-416a-b886-08bb63ea1c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489c817291c1483183e8dddea7de0a0d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:33.741470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5e449a2e-9b3f-4025-bfeb-2e6013ca7958 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:33.742845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e449a2e-9b3f-4025-bfeb-2e6013ca7958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:33.747900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 903/1770] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:33 2022] DELETE /identity/v3/users/489c817291c1483183e8dddea7de0a0d => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:33.754264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87981-d6e0-4773-9d19-e122bb4b4459 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.754264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87981-d6e0-4773-9d19-e122bb4b4459 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.754264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f87981-d6e0-4773-9d19-e122bb4b4459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.807673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c7f87981-d6e0-4773-9d19-e122bb4b4459 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:33.809884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c7f87981-d6e0-4773-9d19-e122bb4b4459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:33.884589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 868/1771] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:33.886377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f32eb-dad5-4d4c-9178-ff34ede46e7d None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:33.886868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f32eb-dad5-4d4c-9178-ff34ede46e7d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:33.887322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f32eb-dad5-4d4c-9178-ff34ede46e7d None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:33.897441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 869/1772] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:58:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:33.980081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f32eb-dad5-4d4c-9178-ff34ede46e7d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:33.981994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a97f32eb-dad5-4d4c-9178-ff34ede46e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:33.982655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 904/1773] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:34.039153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:34.137287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:34.138245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:34.138657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:34.185898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f32eb-dad5-4d4c-9178-ff34ede46e7d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:34.206842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:34.207239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:34.207478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:34.207782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:34.208114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:34.208514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:34.234886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:34.236377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:34.271412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 870/1774] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:34.272283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:34.275032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:34.297840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5d44-0508-4222-97e8-54b5583f36e5 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:34.306738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:34.316512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:34.317217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:34.317491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:34.317756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:34.358060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:34.359999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:34.392653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 871/1775] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:34.445837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 905/1776] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:58:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:35.609830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:35.611680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:35.640861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291457-d781-42b0-a31f-06ec731010c8 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:35.671934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:35.673079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:35.673496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:35.673922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:35.696701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:35.699180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:35.741140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 872/1777] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:36.997016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:36.999219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:37.032710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397f80f-e94b-460d-ab82-82c6bd34e974 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:37.052935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:37.053778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:37.054203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:37.054611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] PATH_INFO: `/v3/projects/547a8ffc8b0c4a24af98e7b952f892b8` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:37.060904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547a8ffc8b0c4a24af98e7b952f892b8)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:37.065008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:37.202859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547a8ffc8b0c4a24af98e7b952f892b8', 'request_id': 'req-5711ae26-ccdc-4043-889a-11da62e6d049'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.229539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547a8ffc8b0c4a24af98e7b952f892b8', 'request_id': 'req-5711ae26-ccdc-4043-889a-11da62e6d049'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.253758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547a8ffc8b0c4a24af98e7b952f892b8', 'request_id': 'req-5711ae26-ccdc-4043-889a-11da62e6d049'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.280108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] The token cache is being invalidate because project 547a8ffc8b0c4a24af98e7b952f892b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:37.280406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.281621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5711ae26-ccdc-4043-889a-11da62e6d049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.285054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 906/1778] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:36 2022] DELETE /identity/v3/projects/547a8ffc8b0c4a24af98e7b952f892b8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:37.288921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:37.309306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52840b5c-4319-41a7-ae6b-52646084e143 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:37.397784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64acf1c-a936-4b16-a78c-90cb45f89278 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:37.398066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64acf1c-a936-4b16-a78c-90cb45f89278 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:37.401681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64acf1c-a936-4b16-a78c-90cb45f89278 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:37.403303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 907/1779] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:58:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:37.558578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:37.559338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:37.559707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:37.559971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] PATH_INFO: `/v3/users/e7b3e8995d0f4114b1cb229da8d12089` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:37.565338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b3e8995d0f4114b1cb229da8d12089)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:37.567487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:37.602324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:37.603066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:37.603526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:37.656451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:37.661557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:37.676397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b3e8995d0f4114b1cb229da8d12089'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.689345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b3e8995d0f4114b1cb229da8d12089'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.690037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b3e8995d0f4114b1cb229da8d12089'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.690742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b3e8995d0f4114b1cb229da8d12089'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.708060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b3e8995d0f4114b1cb229da8d12089'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:37.758982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 873/1780] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:37 2022] DELETE /identity/v3/users/e7b3e8995d0f4114b1cb229da8d12089 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:37.999820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 908/1781] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:38.371448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:38.373010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:38.416711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:38.582572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022b362-c9c7-4763-b7d2-0a6309b07a94 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:38.598256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:38.601131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:38.601889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:38.614079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] PATH_INFO: `/v3/projects/d2363acbcd17425aa2841b7163a76959` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:38.637247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2363acbcd17425aa2841b7163a76959)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:38.657380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:38.833691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2363acbcd17425aa2841b7163a76959', 'request_id': 'req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:38.849785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2363acbcd17425aa2841b7163a76959', 'request_id': 'req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:38.862581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2363acbcd17425aa2841b7163a76959', 'request_id': 'req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:38.882519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] The token cache is being invalidate because project d2363acbcd17425aa2841b7163a76959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:38.882844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:38.884100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:38.885901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 874/1782] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:38 2022] DELETE /identity/v3/projects/d2363acbcd17425aa2841b7163a76959 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:38.890291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:38.911436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964364aa-4972-41b4-ba1c-89198de306d3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:38.998103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:39.136316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:39.137167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:39.137455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:39.140215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] PATH_INFO: `/v3/users/31a647820c3c4152a5af85f7252da9af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:39.146194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a647820c3c4152a5af85f7252da9af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:39.155028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:39.355494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a647820c3c4152a5af85f7252da9af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:39.382600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a647820c3c4152a5af85f7252da9af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:39.383299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a647820c3c4152a5af85f7252da9af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:39.383974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a647820c3c4152a5af85f7252da9af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:39.426028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a647820c3c4152a5af85f7252da9af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:39.503528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 909/1783] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:38 2022] DELETE /identity/v3/users/31a647820c3c4152a5af85f7252da9af => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:39.542528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:39.544055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:39.718009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb8e3-dbc3-4ca3-bed1-24228d11b878 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:39.834648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:39.901488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:39.902849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:39.903135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:39.903397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:39.908368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:39.999519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:40.012537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d7b84-b677-46b4-9622-bae0e87f62b9 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:40.041336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 875/1784] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:40.107181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:40.109234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:40.246671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d1ea8-f0eb-46e2-bd1f-ddc585b42634 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:40.278796 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:40.280866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.281242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.282505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] PATH_INFO: `/v3/projects/6178c3a5329f4f12a52374b43728a022` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.286561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6178c3a5329f4f12a52374b43728a022)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:40.294262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:40.478173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6178c3a5329f4f12a52374b43728a022', 'request_id': 'req-aafb2d58-c92c-42ac-a67e-a15efab1be5c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:40.488531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6178c3a5329f4f12a52374b43728a022', 'request_id': 'req-aafb2d58-c92c-42ac-a67e-a15efab1be5c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:40.493942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:40.505721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6178c3a5329f4f12a52374b43728a022', 'request_id': 'req-aafb2d58-c92c-42ac-a67e-a15efab1be5c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:40.545291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] The token cache is being invalidate because project 6178c3a5329f4f12a52374b43728a022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:40.546375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:40.550364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-aafb2d58-c92c-42ac-a67e-a15efab1be5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:40.562281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.562870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.562997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.566987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 910/1785] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:40 2022] DELETE /identity/v3/projects/6178c3a5329f4f12a52374b43728a022 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:40.610308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:40.611889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:40.806064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.806500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.806865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.815047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 876/1786] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:40.848665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:40.852072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:40.864887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 911/1787] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:40.869563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:40.886219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59edc2b-2e87-47e5-90bf-bbcd10d2dcb3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:40.897318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:40.899362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.900276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.900570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.901443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:40.901782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:40.904962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:40.924406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 877/1788] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:40.929730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:40.942117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293b10-dd29-4939-a29b-0b79d41b51fa None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:40.948750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:40.949863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.950493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.950960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:40.951267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.952179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:40.952761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:40.955029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:40.969289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89623161-f0ac-40a3-a8e6-b82a261ccc51 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:40.980174 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:40.981133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:40.981133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:40.981386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] PATH_INFO: `/v3/projects/7ba9fb09e5a8447fad37bb9f5500bc98` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:40.982533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba9fb09e5a8447fad37bb9f5500bc98)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:40.984574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.030346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 912/1789] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:40 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:41.058028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.125581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba9fb09e5a8447fad37bb9f5500bc98', 'request_id': 'req-807b3e3d-fabf-4440-9b89-db64cbabe933'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:41.134381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba9fb09e5a8447fad37bb9f5500bc98', 'request_id': 'req-807b3e3d-fabf-4440-9b89-db64cbabe933'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:41.154568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba9fb09e5a8447fad37bb9f5500bc98', 'request_id': 'req-807b3e3d-fabf-4440-9b89-db64cbabe933'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:41.168255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeefa12-25df-4fc0-b543-d31344a7a06f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.175707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] The token cache is being invalidate because project 7ba9fb09e5a8447fad37bb9f5500bc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:41.175913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:41.177881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-807b3e3d-fabf-4440-9b89-db64cbabe933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:41.180375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 878/1790] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:40 2022] DELETE /identity/v3/projects/7ba9fb09e5a8447fad37bb9f5500bc98 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:41.185809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1084f06-a42d-4ba1-91f0-2acfd24c2138 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.186087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1084f06-a42d-4ba1-91f0-2acfd24c2138 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.186371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1084f06-a42d-4ba1-91f0-2acfd24c2138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.230839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a1084f06-a42d-4ba1-91f0-2acfd24c2138 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:41.232206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a1084f06-a42d-4ba1-91f0-2acfd24c2138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:41.268155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.268774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.269047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.269381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.270314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.273042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.320534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:41.324150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 913/1791] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:41.327407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.329527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:41.357537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 879/1792] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:41.358644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604caf9-c3e0-4d3b-8f9a-4cca1f0dc273 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.365196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.365550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.365881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.370784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.372403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.372988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.373819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.375180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.378669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.413604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 914/1793] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:41.416962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.428940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:41.430443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:41.432288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25a10e-e057-4795-90c9-405d368491ac admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.440663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.440663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.440914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 880/1794] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:41.441028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.441103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.441786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.443380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.445179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.454822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3368f5-9c6d-4667-b713-6d20b7ae84f7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.463500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 915/1795] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:41.464708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.467357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.468077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.468418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.468780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.469502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:41.469866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.471526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.476029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba2555-6952-4a47-8e81-13edb832e7a9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.481216 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428baa2-8fbb-4b18-8372-368ec0ccb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.481828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428baa2-8fbb-4b18-8372-368ec0ccb968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.482179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428baa2-8fbb-4b18-8372-368ec0ccb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.482456 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428baa2-8fbb-4b18-8372-368ec0ccb968 admin admin] PATH_INFO: `/v3/projects/9c3db6ba11e546cf8809c8c104544c2d/users/9e462e4774d54285901fe46f696eac0a/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.487763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 881/1796] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:58:41.488857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.500370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428baa2-8fbb-4b18-8372-368ec0ccb968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3db6ba11e546cf8809c8c104544c2d, user_id=9e462e4774d54285901fe46f696eac0a, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.501749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbece9f-7d9b-4c8b-a528-964f55820df5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.503148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428baa2-8fbb-4b18-8372-368ec0ccb968 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.509291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.509953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.510230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.510503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.511294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.513158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.517627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 916/1797] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:41 2022] PUT /identity/v3/projects/9c3db6ba11e546cf8809c8c104544c2d/users/9e462e4774d54285901fe46f696eac0a/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:41.528597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.528903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.529169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.542910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:41.550255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 882/1798] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:41.554418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.560015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] MFA Rules not processed for user `9e462e4774d54285901fe46f696eac0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:41.561257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:41.615636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cdfd0-ec7b-4648-8d1b-4ab4177e3e1d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.621596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.622230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.622560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.622823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.623489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.625658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.651478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 883/1799] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:58:41.655651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.657018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 917/1800] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:41.661869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.667452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808715e-5221-41cd-b095-a9800ebeaa28 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.672331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.674015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.674303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.674575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.675252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.676914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.684136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bd392-181d-4837-9a60-555fc93d2760 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.690763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 884/1801] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:41.692124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.692322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.693150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.693528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.693899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.694658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.696829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.704863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55b401-128a-4000-98be-03769cbdbf3e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.730605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.732927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.734491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.734933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.736468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.741176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.742538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 918/1802] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:58:41.745986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.772963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 885/1803] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:41.774961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.797703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a067915-ba88-4dad-b56a-5bd6b7db114e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.863996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784484e-c089-4db4-9915-ff7160cf38aa admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.870451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.872723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.873138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.873508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.875099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.878899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.898013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3e71-2969-43de-8144-b9677ee6d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.899038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3e71-2969-43de-8144-b9677ee6d3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.899335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3e71-2969-43de-8144-b9677ee6d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.899704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3e71-2969-43de-8144-b9677ee6d3a1 admin admin] PATH_INFO: `/v3/projects/20bd62a1eec542a2a9d2fb908d13f6a1/users/4656e9d36b414e1a9b2fb19c4330cf77/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.912582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 919/1804] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:41.915888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:41.917949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.919194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3e71-2969-43de-8144-b9677ee6d3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bd62a1eec542a2a9d2fb908d13f6a1, user_id=4656e9d36b414e1a9b2fb19c4330cf77, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.924809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3e71-2969-43de-8144-b9677ee6d3a1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.932950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13201dce-b90d-43a8-868a-b48ff71cd0a7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:41.939713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:41.940338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.940840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.941116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.941857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:41.943493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:41.951843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 886/1805] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:41 2022] PUT /identity/v3/projects/20bd62a1eec542a2a9d2fb908d13f6a1/users/4656e9d36b414e1a9b2fb19c4330cf77/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:41.965455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 920/1806] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:41.965591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:41.965591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:41.965785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:41.967172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:41.982630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55c385-a48a-4303-92ba-b0ff2321173a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.008226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] MFA Rules not processed for user `4656e9d36b414e1a9b2fb19c4330cf77`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:42.008454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:42.047441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:42.092773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.093610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.095903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.096290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] PATH_INFO: `/v3/projects/7a1ec6d290ad4a37b0314c7e44697fe6/users/a3a5c10ae95b406aaa7dc67dee49b537/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.106569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 887/1807] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:42.107496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.119316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0741-1b93-4c79-a180-abe3d47ca1e1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.125391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.126177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.126329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.127748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.127748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.129887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.130850 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1ec6d290ad4a37b0314c7e44697fe6, user_id=a3a5c10ae95b406aaa7dc67dee49b537, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.137843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.163784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 921/1808] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:41 2022] PUT /identity/v3/projects/7a1ec6d290ad4a37b0314c7e44697fe6/users/a3a5c10ae95b406aaa7dc67dee49b537/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:42.170351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 888/1809] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:42 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:42.175865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.176919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.328707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327de1-8c17-40da-8e9d-b5f966dc8f8f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.373871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55a0f6-ca58-404e-a7a9-438f78ff4984 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.402487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.403589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.404112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.404794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.405939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.410696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.473800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.474774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.475197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.475901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.477029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.479294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.485257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 889/1810] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:42 2022] POST /identity/v3/users => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:58:42.487190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.494325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 922/1811] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:42.501233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.516134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b0a90-b833-411f-9501-19bc024629b9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.518551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e966ff-457a-4c72-b1b9-b1cce6873a72 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.525543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.527420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.527877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.528387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] PATH_INFO: `/v3/projects/7a1ec6d290ad4a37b0314c7e44697fe6/users/a3a5c10ae95b406aaa7dc67dee49b537/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.528673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827a0a-b385-49ee-a7f9-16b2fd773138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.529670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827a0a-b385-49ee-a7f9-16b2fd773138 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.530395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827a0a-b385-49ee-a7f9-16b2fd773138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.530938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827a0a-b385-49ee-a7f9-16b2fd773138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.531104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1ec6d290ad4a37b0314c7e44697fe6, user_id=a3a5c10ae95b406aaa7dc67dee49b537, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.532219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827a0a-b385-49ee-a7f9-16b2fd773138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.534086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.535226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827a0a-b385-49ee-a7f9-16b2fd773138 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.550419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 923/1812] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:42 2022] PUT /identity/v3/projects/7a1ec6d290ad4a37b0314c7e44697fe6/users/a3a5c10ae95b406aaa7dc67dee49b537/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:42.555052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 890/1813] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:42.567426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.575455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.576093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.577257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.655963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] MFA Rules not processed for user `a3a5c10ae95b406aaa7dc67dee49b537`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:42.657917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:42.732147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:42.753718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50186c41-3cb1-4c01-81d9-a11484b19cea admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.761327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.762127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.762529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.762999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] PATH_INFO: `/v3/projects/90cdbbfb957a4531b6118f8f92f9b7d6/users/65e18fbe645f4695897f743d04853e64/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.789960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:42.798245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cdbbfb957a4531b6118f8f92f9b7d6, user_id=65e18fbe645f4695897f743d04853e64, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.805169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.826197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 891/1814] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:42.828665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 924/1815] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:42 2022] PUT /identity/v3/projects/90cdbbfb957a4531b6118f8f92f9b7d6/users/65e18fbe645f4695897f743d04853e64/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:42.833998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.841915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.844861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:42.851295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c481b-6252-4516-8e42-7bf67ce35316 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.911559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.912180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.912478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.912778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.913412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.915016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.916899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846f99b-02d1-4e80-96ce-99f19e1fc4c9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.920934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.921570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.921950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.922404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.929977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 892/1816] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:42.933666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:42.943732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cced5f9-b336-450e-a396-fa7b46a503f5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:42.948530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71696811-c73d-4d5a-aeef-ba64dac975ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:42.949221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71696811-c73d-4d5a-aeef-ba64dac975ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.949495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71696811-c73d-4d5a-aeef-ba64dac975ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.949767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71696811-c73d-4d5a-aeef-ba64dac975ae admin admin] PATH_INFO: `/v3/projects/90cdbbfb957a4531b6118f8f92f9b7d6/users/65e18fbe645f4695897f743d04853e64/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.951661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71696811-c73d-4d5a-aeef-ba64dac975ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cdbbfb957a4531b6118f8f92f9b7d6, user_id=65e18fbe645f4695897f743d04853e64, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.954328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71696811-c73d-4d5a-aeef-ba64dac975ae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:42.966463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 893/1817] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:42 2022] PUT /identity/v3/projects/90cdbbfb957a4531b6118f8f92f9b7d6/users/65e18fbe645f4695897f743d04853e64/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:42.976779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:42.977145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:42.977391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:42.997237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:42.999866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:43.007220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] MFA Rules not processed for user `65e18fbe645f4695897f743d04853e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:43.008503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:43.018792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 925/1818] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:43.114739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 894/1819] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:43.127385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:43.129550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:43.143156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6d8b-8a9e-48a4-8053-36a81bf52f79 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:43.198755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87465f0c-516f-4b0d-88a6-e019d1621e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:43.199481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465f0c-516f-4b0d-88a6-e019d1621e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:43.199764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465f0c-516f-4b0d-88a6-e019d1621e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:43.200042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87465f0c-516f-4b0d-88a6-e019d1621e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:43.211358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87465f0c-516f-4b0d-88a6-e019d1621e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:43.213936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87465f0c-516f-4b0d-88a6-e019d1621e0f service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:43.225525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 926/1820] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:43.386443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:43.429931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:43.465791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee0dd6-8949-4f4e-bc2f-de5ce57eccf2 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:43.470394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:43.471060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:43.471382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:43.471656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] PATH_INFO: `/v3/users/4656e9d36b414e1a9b2fb19c4330cf77` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:43.472895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4656e9d36b414e1a9b2fb19c4330cf77)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:43.475204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:43.550293 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4656e9d36b414e1a9b2fb19c4330cf77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:43.559089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4656e9d36b414e1a9b2fb19c4330cf77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:43.559634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4656e9d36b414e1a9b2fb19c4330cf77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:43.560344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4656e9d36b414e1a9b2fb19c4330cf77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:43.568346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4656e9d36b414e1a9b2fb19c4330cf77'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:43.587208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 895/1821] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:43 2022] DELETE /identity/v3/users/4656e9d36b414e1a9b2fb19c4330cf77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:43.594847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:43.595314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:43.596017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:43.621251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:43.622070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:43.673592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:43.704018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 927/1822] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:43.725728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:43.727233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:43.869548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281bc3c-a48b-4906-b658-8600748e2469 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:43.874241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:43.874876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:43.875153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:43.875425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:43.887281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:43.889040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:43.908665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 896/1823] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:44.439749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:44.441621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:44.505330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa601a2-fa86-4bef-a9e4-892d90fd8738 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:44.509899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:44.511080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:44.511565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:44.512021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:44.515201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:44.601470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:44.603090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:44.640658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 928/1824] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:45.361826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:45.364772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:45.379523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39bd74-d625-4ea9-a438-09062b9b2c1b service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:45.386301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:45.387015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:45.387531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:45.387923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] PATH_INFO: `/v3/projects/20bd62a1eec542a2a9d2fb908d13f6a1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:45.389310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bd62a1eec542a2a9d2fb908d13f6a1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:45.405507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:45.470084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:45.472005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bd62a1eec542a2a9d2fb908d13f6a1', 'request_id': 'req-545ea9ce-3406-491d-b5e9-5709bb33d98a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.480195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bd62a1eec542a2a9d2fb908d13f6a1', 'request_id': 'req-545ea9ce-3406-491d-b5e9-5709bb33d98a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.491324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bd62a1eec542a2a9d2fb908d13f6a1', 'request_id': 'req-545ea9ce-3406-491d-b5e9-5709bb33d98a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.506010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] The token cache is being invalidate because project 20bd62a1eec542a2a9d2fb908d13f6a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:45.506395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.507124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.508913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 897/1825] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:45 2022] DELETE /identity/v3/projects/20bd62a1eec542a2a9d2fb908d13f6a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:45.513090 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:45.524023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4411d4-c844-466b-b2ac-9cfb4c0a63ec service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:45.586529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:45.587178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:45.587460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:45.587733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] PATH_INFO: `/v3/users/65e18fbe645f4695897f743d04853e64` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:45.589007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e18fbe645f4695897f743d04853e64)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:45.590958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:45.637408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:45.648424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e18fbe645f4695897f743d04853e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.686107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e18fbe645f4695897f743d04853e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.686769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e18fbe645f4695897f743d04853e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.688132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e18fbe645f4695897f743d04853e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.696424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fb172a05-163d-4ffc-9d74-e0a2cc686f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e18fbe645f4695897f743d04853e64'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:45.715100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 929/1826] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:45 2022] DELETE /identity/v3/users/65e18fbe645f4695897f743d04853e64 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:46.648727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:46.664172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:46.693363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ea9ce-3406-491d-b5e9-5709bb33d98a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:46.807379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:46.811176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:46.813212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:46.813212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] PATH_INFO: `/v3/projects/90cdbbfb957a4531b6118f8f92f9b7d6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:46.813473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cdbbfb957a4531b6118f8f92f9b7d6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:46.817354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:46.891262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cdbbfb957a4531b6118f8f92f9b7d6', 'request_id': 'req-b2959d05-38d6-4ff6-bbab-94c349ca7283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:46.901556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cdbbfb957a4531b6118f8f92f9b7d6', 'request_id': 'req-b2959d05-38d6-4ff6-bbab-94c349ca7283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:46.925112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cdbbfb957a4531b6118f8f92f9b7d6', 'request_id': 'req-b2959d05-38d6-4ff6-bbab-94c349ca7283'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:46.961003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] The token cache is being invalidate because project 90cdbbfb957a4531b6118f8f92f9b7d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:46.961309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:46.962574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b2959d05-38d6-4ff6-bbab-94c349ca7283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:46.966637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 898/1827] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:46 2022] DELETE /identity/v3/projects/90cdbbfb957a4531b6118f8f92f9b7d6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:46.971218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:46.972155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:46.972741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.013506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:47.016007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:47.098917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 930/1828] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:47.107271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.107627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.108458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.131404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:47.132545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:47.141786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 899/1829] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:47.146103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.164785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f8e5e-bafe-49f1-94b8-5d4917caba09 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.185388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.186128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.186468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.187564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.188441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:47.188778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.190658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.206743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 931/1830] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:47.210402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.219813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe04e1e-d11a-4587-bdbd-74c2fe9c2c50 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.224796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.225640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.225910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.226171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.226838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.228790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.257905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 900/1831] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:47.261854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.272006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258b9e-b28e-4fd5-9693-2361f60e0016 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.335419 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.336048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.336328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.336601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.337276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.339275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.368715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 932/1832] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:47 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:47.373367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.383618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0422-a662-4fb0-b82e-645c4dfac01b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.388584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.389214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.389492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.389760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.390397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.392007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.402310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 901/1833] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:47.406228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.416423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e115a9e-e97a-4c89-acd0-4137147a5a1f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.422042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04d32-d858-4344-b9af-5e05e9ca058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.422632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04d32-d858-4344-b9af-5e05e9ca058e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.422919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04d32-d858-4344-b9af-5e05e9ca058e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.423194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04d32-d858-4344-b9af-5e05e9ca058e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.423958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04d32-d858-4344-b9af-5e05e9ca058e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.425500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee04d32-d858-4344-b9af-5e05e9ca058e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.452984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 933/1834] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:47.457381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.468870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de7d08-72a3-4ad4-8fd0-e4b1dc8d3fa6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.474062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.474750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.475119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.475613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] PATH_INFO: `/v3/projects/f1f97945ad50465d9466c54188908cbe/users/5d640ef97bae4848926e8fa8c4afe64c/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.492098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f97945ad50465d9466c54188908cbe, user_id=5d640ef97bae4848926e8fa8c4afe64c, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.495313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.512642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 902/1835] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:47 2022] PUT /identity/v3/projects/f1f97945ad50465d9466c54188908cbe/users/5d640ef97bae4848926e8fa8c4afe64c/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:47.523886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.524211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.524430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.556016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] MFA Rules not processed for user `5d640ef97bae4848926e8fa8c4afe64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:47.557264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:47.576768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:47.647643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 934/1836] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:47.652812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.657871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:47.726238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b188910-c8a7-4e6f-936e-7d18033efd3d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.734122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.734912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.735730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.736096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.736885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.739379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.791240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 903/1837] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:47 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:47.791380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.804305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434a8da-b69c-473d-8ea2-0924d221b7ff None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.871378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.872641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.873070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.873347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.873994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.875920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.900586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 935/1838] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:47 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:47.904599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.914943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ecc6-38cb-46aa-ae22-6437af2599a2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.920154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.920814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.921092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.921378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.921993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.923748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:47.937020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 904/1839] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:47.940789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:47.952340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bd59c-9c63-4a18-8353-b727c90e6e3e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:47.959112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:47.960115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:47.960430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:47.960861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] PATH_INFO: `/v3/projects/32b058cc57c54ac48643715f07524d27/users/98a72d15f4e645ce9bad3ad5030af5ef/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:47.979557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b058cc57c54ac48643715f07524d27, user_id=98a72d15f4e645ce9bad3ad5030af5ef, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:47.983380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:48.017985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 936/1840] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:47 2022] PUT /identity/v3/projects/32b058cc57c54ac48643715f07524d27/users/98a72d15f4e645ce9bad3ad5030af5ef/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:48.018835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:48.046463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bca37-038c-432c-863c-42551fefe8c3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:48.193463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591badc4-0910-41a7-8786-467cf26b7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:48.194108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591badc4-0910-41a7-8786-467cf26b7e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:48.194391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591badc4-0910-41a7-8786-467cf26b7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:48.194955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591badc4-0910-41a7-8786-467cf26b7e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:48.195313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591badc4-0910-41a7-8786-467cf26b7e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:48.197017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591badc4-0910-41a7-8786-467cf26b7e69 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:48.216187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 905/1841] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:48.220934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:48.237236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b25459-c275-43fe-90b5-787d47c0f037 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:48.252056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:48.253229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:48.253650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:48.255292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] PATH_INFO: `/v3/projects/32b058cc57c54ac48643715f07524d27/users/98a72d15f4e645ce9bad3ad5030af5ef/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:48.259001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b058cc57c54ac48643715f07524d27, user_id=98a72d15f4e645ce9bad3ad5030af5ef, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:48.264150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:48.287721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 937/1842] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:48 2022] PUT /identity/v3/projects/32b058cc57c54ac48643715f07524d27/users/98a72d15f4e645ce9bad3ad5030af5ef/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:48.299196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fd0d-8a5b-44c3-b9df-6d305ec9f345 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:48.299487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fd0d-8a5b-44c3-b9df-6d305ec9f345 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:48.299763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fd0d-8a5b-44c3-b9df-6d305ec9f345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:48.366348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6c31fd0d-8a5b-44c3-b9df-6d305ec9f345 None None] MFA Rules not processed for user `98a72d15f4e645ce9bad3ad5030af5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:48.367720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c31fd0d-8a5b-44c3-b9df-6d305ec9f345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:48.560783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:48.585735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 906/1843] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:48.603389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:48.608188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:48.789639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a53ce1-eca0-4a44-8313-61c354ba7647 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:48.795170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:48.795905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:48.796276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:48.797892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:48.800050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2a7f-b342-4ead-8f7c-2b18b07ccdc7 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:48.800560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2a7f-b342-4ead-8f7c-2b18b07ccdc7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:48.801031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2a7f-b342-4ead-8f7c-2b18b07ccdc7 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:48.802827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 907/1844] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:48.832835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:48.834324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:48.851192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:48.851621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:48.852120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:48.871559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 938/1845] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:48.905060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:48.910654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:48.997111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:49.000588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:49.020037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:49.101132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 908/1846] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:58:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:49.102212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:49.106430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:49.134395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ac566-312a-465f-a1bf-ecd7391514ad None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:49.144861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:49.147726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:49.148846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:49.150454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:49.191175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86cbd-f9df-448d-892e-6810162219bf service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:49.222861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:49.223576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:49.223854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:49.224124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] PATH_INFO: `/v3/users/9e462e4774d54285901fe46f696eac0a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:49.226088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e462e4774d54285901fe46f696eac0a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:49.228074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:49.301512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:49.303802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:49.324523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 909/1847] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:49.343728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e462e4774d54285901fe46f696eac0a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:49.357974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e462e4774d54285901fe46f696eac0a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:49.358861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e462e4774d54285901fe46f696eac0a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:49.359734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e462e4774d54285901fe46f696eac0a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:49.375117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-61984652-d382-4860-8c5f-790efd3040cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e462e4774d54285901fe46f696eac0a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:49.414024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:49.415544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:49.419382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 939/1848] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:48 2022] DELETE /identity/v3/users/9e462e4774d54285901fe46f696eac0a => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:49.424089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:49.424380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:49.424749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:49.442138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bac5d-ad7b-4585-8fb6-abba9c015a74 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:49.461954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:49.463202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:49.550978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 940/1849] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:49.556467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:49.557173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:49.557426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:49.557798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:49.563003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:49.566503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:49.568085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:49.586186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:49.588391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:49.604871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 910/1850] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:49.608818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:49.645652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f6851-89e4-4ea5-99a6-cfe03e1ba38c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:49.650296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:49.661667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:49.661667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:49.661667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:49.684283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:49.686062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:49.699884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 941/1851] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:50.135821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:50.137328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:50.160329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848ca61-fea6-40ee-a428-109087529ec9 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:50.165818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:50.166685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:50.167225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:50.167672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] PATH_INFO: `/v3/projects/9c3db6ba11e546cf8809c8c104544c2d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:50.169097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3db6ba11e546cf8809c8c104544c2d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:50.171214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:50.180200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:50.232587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3db6ba11e546cf8809c8c104544c2d', 'request_id': 'req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.240936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3db6ba11e546cf8809c8c104544c2d', 'request_id': 'req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.250107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3db6ba11e546cf8809c8c104544c2d', 'request_id': 'req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.262433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] The token cache is being invalidate because project 9c3db6ba11e546cf8809c8c104544c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:50.262761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.263512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.265959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 911/1852] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:50 2022] DELETE /identity/v3/projects/9c3db6ba11e546cf8809c8c104544c2d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:50.269916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:50.280175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735430d-9687-4b35-92bd-f281f94a3aff service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:50.339632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:50.340485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:50.340777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:50.341066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] PATH_INFO: `/v3/users/a3a5c10ae95b406aaa7dc67dee49b537` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:50.342206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a5c10ae95b406aaa7dc67dee49b537)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:50.344161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:50.394953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a5c10ae95b406aaa7dc67dee49b537'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.402433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a5c10ae95b406aaa7dc67dee49b537'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.403440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a5c10ae95b406aaa7dc67dee49b537'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.404208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a5c10ae95b406aaa7dc67dee49b537'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.416260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-66268250-ad1b-405a-a076-64eb119d85b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a5c10ae95b406aaa7dc67dee49b537'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:50.452104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 942/1853] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:50 2022] DELETE /identity/v3/users/a3a5c10ae95b406aaa7dc67dee49b537 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:50.967816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:50.970368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:50.999888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dd3a5-8760-48f7-99fd-9f4ed12fbe6b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.121625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.122500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.123155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.123563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] PATH_INFO: `/v3/projects/7a1ec6d290ad4a37b0314c7e44697fe6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.137617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1ec6d290ad4a37b0314c7e44697fe6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.140419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.229081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1ec6d290ad4a37b0314c7e44697fe6', 'request_id': 'req-5e9533be-c640-4205-ae76-d830a9346923'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:51.236157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1ec6d290ad4a37b0314c7e44697fe6', 'request_id': 'req-5e9533be-c640-4205-ae76-d830a9346923'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:51.247833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1ec6d290ad4a37b0314c7e44697fe6', 'request_id': 'req-5e9533be-c640-4205-ae76-d830a9346923'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:51.267129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] The token cache is being invalidate because project 7a1ec6d290ad4a37b0314c7e44697fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:51.267580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:51.268325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5e9533be-c640-4205-ae76-d830a9346923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:51.271902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 912/1854] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:50 2022] DELETE /identity/v3/projects/7a1ec6d290ad4a37b0314c7e44697fe6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:51.278832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.279343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.280098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.308460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:51.310188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:51.371211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:51.384869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 943/1855] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:51.391915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.392285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.392750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.417860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:51.420292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:51.432850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 913/1856] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:51.437637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.448867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f82e-0f61-4398-b32e-2cb19e74d0cf None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.453727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.454442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.454961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.455814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.456887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:51.457807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.459351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.472509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 944/1857] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:51.476849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.486665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba03e-ecf6-410f-8ce5-aeb370e120fd None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.492476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.493142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.493719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.493719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.494778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.497130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.520259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:51.536318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 914/1858] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:51 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:51.540587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.551870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077c3be-8d81-4540-83d4-ddc1dc9a8dc0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.633376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.634446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.634852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.635167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.636570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.639349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.671582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 945/1859] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:51 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:51.675626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.689131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e2fcc-d9e6-4741-bc87-c5811e3c8b7f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.694947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.695847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.696223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.696584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.697445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.699125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.710796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 915/1860] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:51.714995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.729637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aa90a-4d90-4820-a31c-dd25d757dcd6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.736066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8fa34-d05c-4c2f-916e-9f82f918d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.737080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8fa34-d05c-4c2f-916e-9f82f918d517 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.737535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8fa34-d05c-4c2f-916e-9f82f918d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.738675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8fa34-d05c-4c2f-916e-9f82f918d517 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.739464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8fa34-d05c-4c2f-916e-9f82f918d517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.741231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8fa34-d05c-4c2f-916e-9f82f918d517 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.757683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 946/1861] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:51.761870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.772969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493bfb-f1e3-43c5-b581-589993874814 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.778231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.778989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.779322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.779633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] PATH_INFO: `/v3/projects/21316960794a462ca30bf4997e82e50f/users/06ad5aca157041d4a6b5a07aff59d38d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.796078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21316960794a462ca30bf4997e82e50f, user_id=06ad5aca157041d4a6b5a07aff59d38d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:51.798829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:51.812846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 916/1862] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:51 2022] PUT /identity/v3/projects/21316960794a462ca30bf4997e82e50f/users/06ad5aca157041d4a6b5a07aff59d38d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:51.824501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.824915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.825188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:51.852553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] MFA Rules not processed for user `06ad5aca157041d4a6b5a07aff59d38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:51.853787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:51.918303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 947/1863] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:51.923092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:51.990869 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273327df-ec75-4193-82f4-e0767a7c7a61 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:51.998647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:51.999242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:51.999515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:51.999776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.001137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.004013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.037493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 917/1864] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:51 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:52.041336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:52.056643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff1221-866c-473f-8f33-544ddc259e33 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:52.116469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:52.150324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:52.150960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.151274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.151551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.152207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.154559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.187298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 948/1865] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:52 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:52.191421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:52.203302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdad9e-8d6d-4f8e-a1df-c9ba6d4f7159 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:52.210283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:52.211028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.211304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.213000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.214472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.216517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.233883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:52.234724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 918/1866] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:52.246843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa43d0-2351-4f68-bf30-952abc669fb6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:52.251690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:52.252856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.252856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.253034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] PATH_INFO: `/v3/projects/d9925d012bd24e16b614261907b512b2/users/d465908edde1401fa4e02559c46a40bf/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.270293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9925d012bd24e16b614261907b512b2, user_id=d465908edde1401fa4e02559c46a40bf, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.273289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.296945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 949/1867] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:52 2022] PUT /identity/v3/projects/d9925d012bd24e16b614261907b512b2/users/d465908edde1401fa4e02559c46a40bf/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:52.301524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:52.317320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbc0df-1639-4422-8f1d-a69a3ab06d12 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:52.412877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23c28-c3bc-4c4c-bef1-fbca10b42246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:52.413503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23c28-c3bc-4c4c-bef1-fbca10b42246 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.413775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23c28-c3bc-4c4c-bef1-fbca10b42246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.414049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23c28-c3bc-4c4c-bef1-fbca10b42246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.414836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23c28-c3bc-4c4c-bef1-fbca10b42246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.416440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23c28-c3bc-4c4c-bef1-fbca10b42246 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.446117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 919/1868] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:52.450820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:52.479889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678882c8-c4ac-4a64-8729-a530c67eac55 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:52.497347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:52.499320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.499908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.500200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] PATH_INFO: `/v3/projects/d9925d012bd24e16b614261907b512b2/users/d465908edde1401fa4e02559c46a40bf/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.504359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9925d012bd24e16b614261907b512b2, user_id=d465908edde1401fa4e02559c46a40bf, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.507858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.549409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 950/1869] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:52 2022] PUT /identity/v3/projects/d9925d012bd24e16b614261907b512b2/users/d465908edde1401fa4e02559c46a40bf/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:52.551056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.551342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.551611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.603290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] MFA Rules not processed for user `d465908edde1401fa4e02559c46a40bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:52.604871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:52.628846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:52.687147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 920/1870] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:52.699034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:52.700843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:52.770004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43b2ca-2777-4955-bac1-6f39f4767de0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:52.776903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e82e8f-26b7-459e-91e5-a16551bd8e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:52.776903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e82e8f-26b7-459e-91e5-a16551bd8e2d service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:52.776903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e82e8f-26b7-459e-91e5-a16551bd8e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:52.776903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e82e8f-26b7-459e-91e5-a16551bd8e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:52.793226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e82e8f-26b7-459e-91e5-a16551bd8e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:52.797765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e82e8f-26b7-459e-91e5-a16551bd8e2d service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:52.809635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 951/1871] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:54.037773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:54.103150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4fc7e-d2fe-4b80-842b-4069b7a3b372 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:54.108627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:54.109333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:54.109583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:54.109855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] PATH_INFO: `/v3/users/06ad5aca157041d4a6b5a07aff59d38d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:54.110989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ad5aca157041d4a6b5a07aff59d38d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:54.112923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:54.179795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ad5aca157041d4a6b5a07aff59d38d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:54.190333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ad5aca157041d4a6b5a07aff59d38d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:54.190835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ad5aca157041d4a6b5a07aff59d38d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:54.191814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ad5aca157041d4a6b5a07aff59d38d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:54.200452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ad5aca157041d4a6b5a07aff59d38d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:54.220163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 921/1872] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:54 2022] DELETE /identity/v3/users/06ad5aca157041d4a6b5a07aff59d38d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:54.224743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:54.225226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:54.225341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:54.243977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:54.245676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:54.313081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 952/1873] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:54.323374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:54.324923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:54.373811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:54.437166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1836-eb77-4ee9-8e55-6b648a1ce5f7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:54.443513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:54.444152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:54.444454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:54.444733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:54.464108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:54.465744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:54.478396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 922/1874] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:58:54.967284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:54.969363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:54.994650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35687f-721f-4cdd-8a80-eb3f61078da4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:55.005374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:55.006548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.006997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.007500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] PATH_INFO: `/v3/projects/21316960794a462ca30bf4997e82e50f` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.008890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] RBAC: Authorizing `identity:delete_project(project_id=21316960794a462ca30bf4997e82e50f)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:55.011089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:55.049811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:55.051411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.080981 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b812a-e72f-4508-b660-b7a9ae71a5d4 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:55.093925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:55.094934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.095370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.095786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] PATH_INFO: `/v3/users/2fd31dfb0e6e4f6b89c91ff9175d4093` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.097477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd31dfb0e6e4f6b89c91ff9175d4093)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:55.099791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:55.115083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:55.139263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21316960794a462ca30bf4997e82e50f', 'request_id': 'req-4316c70c-a494-4341-b2d2-61473d3e662c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.151560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21316960794a462ca30bf4997e82e50f', 'request_id': 'req-4316c70c-a494-4341-b2d2-61473d3e662c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.179675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21316960794a462ca30bf4997e82e50f', 'request_id': 'req-4316c70c-a494-4341-b2d2-61473d3e662c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.204173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] The token cache is being invalidate because project 21316960794a462ca30bf4997e82e50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:55.204665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.205545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.207743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 953/1875] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:54 2022] DELETE /identity/v3/projects/21316960794a462ca30bf4997e82e50f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:55.211582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:55.217491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.269724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd31dfb0e6e4f6b89c91ff9175d4093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.281880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd31dfb0e6e4f6b89c91ff9175d4093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.282995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd31dfb0e6e4f6b89c91ff9175d4093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.283945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd31dfb0e6e4f6b89c91ff9175d4093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.293979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-43e84a8c-4b95-4071-9f9f-529fa3aa7c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd31dfb0e6e4f6b89c91ff9175d4093'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.329968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 923/1876] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:55 2022] DELETE /identity/v3/users/2fd31dfb0e6e4f6b89c91ff9175d4093 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:55.334676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.335161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.335603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.381404 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:55.389899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.396870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316c70c-a494-4341-b2d2-61473d3e662c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:55.487454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 924/1877] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:55.488983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:55.490521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.494820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:55.495883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.496165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.496570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] PATH_INFO: `/v3/users/d465908edde1401fa4e02559c46a40bf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.497780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d465908edde1401fa4e02559c46a40bf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:55.499778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:55.507736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebfc06-906a-40d4-81de-fba05b9b977f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:55.519085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:55.519738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.520015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.520325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] PATH_INFO: `/v3/users/5d640ef97bae4848926e8fa8c4afe64c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.521632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d640ef97bae4848926e8fa8c4afe64c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:55.527399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:55.571900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd465908edde1401fa4e02559c46a40bf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.583695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd465908edde1401fa4e02559c46a40bf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.585966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd465908edde1401fa4e02559c46a40bf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.587828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd465908edde1401fa4e02559c46a40bf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.597274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d640ef97bae4848926e8fa8c4afe64c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.598608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd465908edde1401fa4e02559c46a40bf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.599010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:55.608443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d640ef97bae4848926e8fa8c4afe64c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.609188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d640ef97bae4848926e8fa8c4afe64c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.609985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d640ef97bae4848926e8fa8c4afe64c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.610425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:55.632852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 954/1878] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:55 2022] DELETE /identity/v3/users/d465908edde1401fa4e02559c46a40bf => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:55.635937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:55.639374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.641320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-192f366b-490c-4655-96e1-e6f42c788e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d640ef97bae4848926e8fa8c4afe64c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:55.684203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 925/1879] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:55 2022] DELETE /identity/v3/users/5d640ef97bae4848926e8fa8c4afe64c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:55.690218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.690593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.690868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.737034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:55.738299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.748558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d954e-3752-48e2-aeb3-e8d7cbc2d570 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:55.811694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:55.812432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.812735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.813007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.816763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.873288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 926/1880] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:55.930471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:55.933088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:55.936594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:55.938787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:55.945120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 955/1881] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:55.957111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba400ff0-ffb3-4017-ae10-b511898a50b0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:55.962521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:55.963415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:55.963574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:55.964115 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:55.982777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:55.984411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:56.013805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 927/1882] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:56.571217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:56.572972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:56.592342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c018a-7953-4ab5-a6c1-eb225c9b98d2 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:56.602270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:56.604167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:56.604167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:56.604167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] PATH_INFO: `/v3/projects/d9925d012bd24e16b614261907b512b2` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:56.607618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9925d012bd24e16b614261907b512b2)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:56.608335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:56.625216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:56.626660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:56.653202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39489c-1a4e-4bed-9310-837d55aa4270 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:56.678189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:56.680378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:56.680378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:56.680378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] PATH_INFO: `/v3/projects/f1f97945ad50465d9466c54188908cbe` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:56.681508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f97945ad50465d9466c54188908cbe)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:56.683705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:56.736823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9925d012bd24e16b614261907b512b2', 'request_id': 'req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.738345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:56.749989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9925d012bd24e16b614261907b512b2', 'request_id': 'req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.763743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9925d012bd24e16b614261907b512b2', 'request_id': 'req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.764752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f97945ad50465d9466c54188908cbe', 'request_id': 'req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.775518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f97945ad50465d9466c54188908cbe', 'request_id': 'req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.791228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f97945ad50465d9466c54188908cbe', 'request_id': 'req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.802786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] The token cache is being invalidate because project d9925d012bd24e16b614261907b512b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:56.803172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.803775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.805617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 956/1883] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:56 2022] DELETE /identity/v3/projects/d9925d012bd24e16b614261907b512b2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:56.806757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:56.810853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:56.813122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] The token cache is being invalidate because project f1f97945ad50465d9466c54188908cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:56.813415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.814063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-77c3f5c5-9c62-40a9-a6c1-9e553dba7efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.816339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 928/1884] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:56 2022] DELETE /identity/v3/projects/f1f97945ad50465d9466c54188908cbe => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:56.817513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:56.817794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:56.818064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:56.839640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:56.840897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:56.874457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:56.906728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19f4f-c1cd-458b-a063-a1c1dcb1c87c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:56.909199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 929/1885] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:56.910083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:56.911411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:56.919152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:56.919819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:56.920101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:56.920373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] PATH_INFO: `/v3/projects/324235c6062f47a48ff74f6f238504a8` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:56.921551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=324235c6062f47a48ff74f6f238504a8)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:56.923469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:56.927382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a81ab-6a90-4d60-a2cb-7b2c8b8a6f42 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:56.934275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:56.935030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:56.935305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:56.935572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] PATH_INFO: `/v3/users/98a72d15f4e645ce9bad3ad5030af5ef` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:56.937059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a72d15f4e645ce9bad3ad5030af5ef)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:56.939088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:56.982837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324235c6062f47a48ff74f6f238504a8', 'request_id': 'req-4df42f84-6db9-48d0-8ba6-f679f846b05d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.989795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324235c6062f47a48ff74f6f238504a8', 'request_id': 'req-4df42f84-6db9-48d0-8ba6-f679f846b05d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:56.998941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324235c6062f47a48ff74f6f238504a8', 'request_id': 'req-4df42f84-6db9-48d0-8ba6-f679f846b05d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.000970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a72d15f4e645ce9bad3ad5030af5ef'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.011025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a72d15f4e645ce9bad3ad5030af5ef'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.011873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] The token cache is being invalidate because project 324235c6062f47a48ff74f6f238504a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:57.012164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.012483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a72d15f4e645ce9bad3ad5030af5ef'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.012828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-4df42f84-6db9-48d0-8ba6-f679f846b05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.013541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a72d15f4e645ce9bad3ad5030af5ef'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.014496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 957/1886] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:56 2022] DELETE /identity/v3/projects/324235c6062f47a48ff74f6f238504a8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:57.015615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.015895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.016162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.024564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a72d15f4e645ce9bad3ad5030af5ef'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.037618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:57.038893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:57.043371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 930/1887] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:56 2022] DELETE /identity/v3/users/98a72d15f4e645ce9bad3ad5030af5ef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:57.045557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.049189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:57.133995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 958/1888] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:57.139353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.156779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafcb10-059c-4bf2-8b3e-e6e5861c6a86 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.164538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:57.176211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9944f2-46cc-4627-a8cd-0d663b7ea836 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.182000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.182907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.183276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.183637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] PATH_INFO: `/v3/users/b91c90ffe4984d719a6d2c7ee9cf9291` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.185029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91c90ffe4984d719a6d2c7ee9cf9291)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.187200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.232637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.233380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.233488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.233697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.234350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:57.234672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.236458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.262606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 959/1889] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:57.269781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.284012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91c90ffe4984d719a6d2c7ee9cf9291'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.289906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:57.301377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940ebd4-341b-4abf-9381-67a4e73f997e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.302702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91c90ffe4984d719a6d2c7ee9cf9291'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.303382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91c90ffe4984d719a6d2c7ee9cf9291'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.304152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91c90ffe4984d719a6d2c7ee9cf9291'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.319681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91c90ffe4984d719a6d2c7ee9cf9291'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.325891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.326531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.326804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.327068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.327986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.336005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.352081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 931/1890] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:57 2022] DELETE /identity/v3/users/b91c90ffe4984d719a6d2c7ee9cf9291 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:57.391757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 960/1891] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:57 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:57.392848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.394657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:57.529799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871529a-26df-4169-9416-54c076eec2f6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.606392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.608464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:57.667529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.669283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.669726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.670133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.670913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.673788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.703084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 932/1892] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:57 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:58:57.717139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.739744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea4b6f-ce4f-4b7f-a5ed-fbf83ee2aa41 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.745678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.759340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae947-1d4b-42cc-af9b-aa28df283b51 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.760767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.761056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.761348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.762549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.764830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.765842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.767059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.767898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.768320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] PATH_INFO: `/v3/projects/32b058cc57c54ac48643715f07524d27` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.769856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b058cc57c54ac48643715f07524d27)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.778041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 933/1893] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:57.782246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.789971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.817600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d8a24-26d5-44eb-8420-73482162add2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.844284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:57.845372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:57.845770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:57.846140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:57.847074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:57.859221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:57.868320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b058cc57c54ac48643715f07524d27', 'request_id': 'req-f03a69ab-81f8-450f-96a0-17059cf5e646'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.875748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 934/1894] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:57.878942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b058cc57c54ac48643715f07524d27', 'request_id': 'req-f03a69ab-81f8-450f-96a0-17059cf5e646'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.879963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.898673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b058cc57c54ac48643715f07524d27', 'request_id': 'req-f03a69ab-81f8-450f-96a0-17059cf5e646'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.920245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] The token cache is being invalidate because project 32b058cc57c54ac48643715f07524d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:57.920245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.920245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:57.920517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b45bd6-222e-46e6-9d75-96dbb7d3cbfa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:57.925676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 961/1895] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:57 2022] DELETE /identity/v3/projects/32b058cc57c54ac48643715f07524d27 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:57.926714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:57.928085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:57.951341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:58.020841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:58.031363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a69ab-81f8-450f-96a0-17059cf5e646 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.036474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.037334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.037618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.037890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] PATH_INFO: `/v3/projects/df5ce45967f34cf98c8925aaa4a5e385` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.039220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5ce45967f34cf98c8925aaa4a5e385)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.041222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.051574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9228cf8-1b61-47ab-8942-14a53481a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.052895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9228cf8-1b61-47ab-8942-14a53481a137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.053665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9228cf8-1b61-47ab-8942-14a53481a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.054223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9228cf8-1b61-47ab-8942-14a53481a137 admin admin] PATH_INFO: `/v3/projects/813693623d8b432c98ac8ad51f22295d/users/7922bca503bf423d9796cec2106df14e/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.074791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9228cf8-1b61-47ab-8942-14a53481a137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813693623d8b432c98ac8ad51f22295d, user_id=7922bca503bf423d9796cec2106df14e, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.080111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9228cf8-1b61-47ab-8942-14a53481a137 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.097952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 935/1896] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:57 2022] PUT /identity/v3/projects/813693623d8b432c98ac8ad51f22295d/users/7922bca503bf423d9796cec2106df14e/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:58.099845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c4bd-b136-4d11-b7bc-614eb4757bf7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.100134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c4bd-b136-4d11-b7bc-614eb4757bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.100411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827c4bd-b136-4d11-b7bc-614eb4757bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.108059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5ce45967f34cf98c8925aaa4a5e385', 'request_id': 'req-384740c4-06c0-47e0-ba5d-d021584b2d95'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:58.116685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5ce45967f34cf98c8925aaa4a5e385', 'request_id': 'req-384740c4-06c0-47e0-ba5d-d021584b2d95'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:58.129364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a827c4bd-b136-4d11-b7bc-614eb4757bf7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.130681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a827c4bd-b136-4d11-b7bc-614eb4757bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.134631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5ce45967f34cf98c8925aaa4a5e385', 'request_id': 'req-384740c4-06c0-47e0-ba5d-d021584b2d95'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:58.153145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] The token cache is being invalidate because project df5ce45967f34cf98c8925aaa4a5e385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:58.153528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:58.157543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-384740c4-06c0-47e0-ba5d-d021584b2d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:58.159245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 962/1897] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:57 2022] DELETE /identity/v3/projects/df5ce45967f34cf98c8925aaa4a5e385 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:58.162566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e7c8-ba6c-4f73-86d3-e27e23a6edbd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.162566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e7c8-ba6c-4f73-86d3-e27e23a6edbd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.162566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e7c8-ba6c-4f73-86d3-e27e23a6edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.182302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-cf72e7c8-ba6c-4f73-86d3-e27e23a6edbd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.183877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-cf72e7c8-ba6c-4f73-86d3-e27e23a6edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.203833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 936/1898] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:58.204983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594795-b290-4437-95c9-3d3925a3c2be None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.205268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594795-b290-4437-95c9-3d3925a3c2be None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.205562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594795-b290-4437-95c9-3d3925a3c2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.228436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9a594795-b290-4437-95c9-3d3925a3c2be None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.230044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a594795-b290-4437-95c9-3d3925a3c2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.238109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 937/1899] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:58.246261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.246613 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.246888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.261745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 963/1900] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:58.265044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.265044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.265044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.268698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.269979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.278846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 938/1901] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:58.278846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.281284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.287408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.288724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.298322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 964/1902] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:58.299477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.310854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b30c0-cdbe-4d68-968b-7b7c4d5d0155 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.316019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.316917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.317485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.318066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.320119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:58.320449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.322128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.336829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 965/1903] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:58.336829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.348980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838122b-d8cd-4a18-a86d-32d1882c9067 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.351389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5af749-4170-41cb-9edd-cdf0a5a0e12b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.353905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.354649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.354997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.355177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.355390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.355751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.356022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.356120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:58.356283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.356395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.358056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.365859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.367289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.371997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 966/1904] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:58.372591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.380824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 939/1905] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:58.381704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.384765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4cee-42a4-4dda-82da-f4b79b3c8ccf admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.389799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.390454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.390684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.390949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.391576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.394025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.396539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0387-17cf-4221-bea9-7effab2f1b9c service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.399347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:58.403654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.404957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.405568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.405957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.406868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.409287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.457128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 967/1906] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:58.461596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.477972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 940/1907] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:58.483414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.537088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:58.607009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6512ef-9e3a-44c0-b225-517b3e40035e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.613822 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.614593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.616868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.616868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.617272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35043fae-c02c-4e75-91fa-8cae5f497440 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.617741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.621643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.622947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.623707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.624042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.624377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.625142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.627347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.655125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 968/1908] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:58.661990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.676572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 941/1909] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:58:58.679884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.689043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acced29-cdf5-4fc6-969f-d697dc2855be admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.698449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.699083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.701523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d0b4-0e52-48e2-b822-fe406301fe11 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.702202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.702483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.703152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.706547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.725895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.727658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.727945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.728373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.729659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.730598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.741948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 969/1910] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:58.746286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.755979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 942/1911] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:58.759108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.772135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c971b-3590-4fca-a850-2e81f9ec2435 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.777883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a39d2-23e0-4790-bb45-bb7b5cf55a44 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.780569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.781260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.781529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.781801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.782552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.784182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.789523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.790660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.790946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.791219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.792781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.794409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.802075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 970/1912] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:58.806620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.820825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 943/1913] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:58.825380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:58.828517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d7c8-fe42-47fb-acc4-70a11c74d447 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.841487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878189-e5cc-47ab-a013-d6c932a8c854 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:58.841671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca581e-9e92-4b9b-befa-71ef5b02411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.841671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca581e-9e92-4b9b-befa-71ef5b02411c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.841671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca581e-9e92-4b9b-befa-71ef5b02411c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.841671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca581e-9e92-4b9b-befa-71ef5b02411c admin admin] PATH_INFO: `/v3/projects/6a393a312b2f49c2900b1ff8ac100287/users/9cc6e234afa34a809338c40499e0db3b/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.844072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126cb54-e0f2-4849-b948-24ccf7807a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:58.844072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126cb54-e0f2-4849-b948-24ccf7807a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.844072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126cb54-e0f2-4849-b948-24ccf7807a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.844072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126cb54-e0f2-4849-b948-24ccf7807a31 admin admin] PATH_INFO: `/v3/projects/a3fe7ce867734f5eb35b2f6c7e6b9a01/users/f887f137ffc843acb7633ef2514fba6c/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.876648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca581e-9e92-4b9b-befa-71ef5b02411c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a393a312b2f49c2900b1ff8ac100287, user_id=9cc6e234afa34a809338c40499e0db3b, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.878918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126cb54-e0f2-4849-b948-24ccf7807a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fe7ce867734f5eb35b2f6c7e6b9a01, user_id=f887f137ffc843acb7633ef2514fba6c, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:58.881682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126cb54-e0f2-4849-b948-24ccf7807a31 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.886670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca581e-9e92-4b9b-befa-71ef5b02411c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:58.911735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 944/1915] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:58 2022] PUT /identity/v3/projects/a3fe7ce867734f5eb35b2f6c7e6b9a01/users/f887f137ffc843acb7633ef2514fba6c/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:58.913428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 971/1915] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:58 2022] PUT /identity/v3/projects/6a393a312b2f49c2900b1ff8ac100287/users/9cc6e234afa34a809338c40499e0db3b/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:58.929913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.930198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.930468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.934355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:58.934657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:58.935914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:58.970503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] MFA Rules not processed for user `9cc6e234afa34a809338c40499e0db3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.971743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:58.977735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] MFA Rules not processed for user `f887f137ffc843acb7633ef2514fba6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:58.980008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:59.108774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 972/1916] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:59.112354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.131992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 945/1917] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:59.146010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.149066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:59.150861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:59.249929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a6a6f-6817-487a-a3bb-ffec70705f55 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.255818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.256763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.257744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.258180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.258931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.261116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.281978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff830f-00e0-4301-b44c-301d8280fcb4 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.289963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.292963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.293442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.296901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 973/1918] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:59 2022] POST /identity/v3/projects => generated 363 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:59.298808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.301078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.323326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.324806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.347266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 946/1919] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:59.407152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54fd9-eed4-461a-8873-7f4bf5baa30a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.429241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b993b1d-bf1a-4567-8a2d-4aa9a7263d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.454638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993b1d-bf1a-4567-8a2d-4aa9a7263d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.457537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993b1d-bf1a-4567-8a2d-4aa9a7263d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.458012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b993b1d-bf1a-4567-8a2d-4aa9a7263d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.463112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993b1d-bf1a-4567-8a2d-4aa9a7263d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.469515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b993b1d-bf1a-4567-8a2d-4aa9a7263d8e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.517948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 974/1920] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:59 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:59.518994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.538797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3e03c-e650-4b28-b763-06ae23cd7346 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.559960 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.560478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.560923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.564606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.568154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.569011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.569321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.570129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.578794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.584468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:59.603685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] MFA Rules not processed for user `7922bca503bf423d9796cec2106df14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:59.605008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:59.613355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 947/1921] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:59.614712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.638771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761f6d2-6f59-4397-9784-40040ed0e804 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.650256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.650959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.651272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.653482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] PATH_INFO: `/v3/projects/4c79c65835d94ac99e437e63e585ac3f/users/db4a81e739f74179a0d033b9201a727d/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.679713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c79c65835d94ac99e437e63e585ac3f, user_id=db4a81e739f74179a0d033b9201a727d, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.684568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.706435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 975/1922] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:58:59.707754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.710193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:59.715651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 948/1923] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:59 2022] PUT /identity/v3/projects/4c79c65835d94ac99e437e63e585ac3f/users/db4a81e739f74179a0d033b9201a727d/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:59.719602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.726630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c926437-c347-469b-b2e1-241672e7ff60 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.765623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:59.819563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8193c-95c3-4f33-874c-0e6a0e8a5914 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.825117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.825870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.826219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.826469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.827263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.828235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.828888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.828998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.829251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.830454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.830454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.833147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.843998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 949/1924] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:59.848993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.877197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45272f8-bf72-47ef-b34e-71046529adba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:59.884250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed47c8b-27a2-4de2-9a33-91527468ebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:59.893113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed47c8b-27a2-4de2-9a33-91527468ebc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.896247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 976/1925] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:59 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:59.896446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed47c8b-27a2-4de2-9a33-91527468ebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.896726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed47c8b-27a2-4de2-9a33-91527468ebc9 admin admin] PATH_INFO: `/v3/projects/4c79c65835d94ac99e437e63e585ac3f/users/db4a81e739f74179a0d033b9201a727d/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:59.900025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:59.904584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed47c8b-27a2-4de2-9a33-91527468ebc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c79c65835d94ac99e437e63e585ac3f, user_id=db4a81e739f74179a0d033b9201a727d, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:59.918651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed47c8b-27a2-4de2-9a33-91527468ebc9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:59.975358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 950/1926] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:59 2022] PUT /identity/v3/projects/4c79c65835d94ac99e437e63e585ac3f/users/db4a81e739f74179a0d033b9201a727d/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:58:59.976189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:59.976683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:59.976683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.051408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] MFA Rules not processed for user `db4a81e739f74179a0d033b9201a727d`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:00.053199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:00.087131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60260f6-1250-4aa3-ad80-19a7bee72576 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.213528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 951/1927] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:00.230153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:00.231100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:00.275556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.277126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.277870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.278588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.279370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.281811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.298382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:00.323824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 977/1928] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:59 2022] POST /identity/v3/users => generated 293 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:00.324022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48621af-6e6f-4fd3-9354-12ae31eb9b13 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.325528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:00.327330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.328195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.328738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.329342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.335860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b90a1b-932e-4e04-b1e3-55896cd68311 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.340832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.340969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.341565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.341848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.342788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.342898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.342976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.344369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.354523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 952/1929] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:00.356012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 978/1930] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:00.360479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:00.371349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396d033-e610-4f1c-a636-5b960efc40cd service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.377846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.378602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.378954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.379290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] PATH_INFO: `/v3/projects/39921738f8cf4304b2b27a54df35ddc5/users/9c4b50cd24bc4f7897456cb39f3591c1/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.398036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39921738f8cf4304b2b27a54df35ddc5, user_id=9c4b50cd24bc4f7897456cb39f3591c1, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.400744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.435936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 953/1931] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:00 2022] PUT /identity/v3/projects/39921738f8cf4304b2b27a54df35ddc5/users/9c4b50cd24bc4f7897456cb39f3591c1/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:00.441645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:00.456445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c695f15-b045-4a5b-8d7d-63be55ebc591 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.479796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:00.505949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:00.538311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.539625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.539939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.540210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.541061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.543372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2c06-c7d5-4356-8c1a-e3cd92ebec50 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.543490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.547180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710ef54-1213-49f2-ac7d-dffb38ca22ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.547876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710ef54-1213-49f2-ac7d-dffb38ca22ea service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.548229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710ef54-1213-49f2-ac7d-dffb38ca22ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.548558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710ef54-1213-49f2-ac7d-dffb38ca22ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.555130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 979/1932] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:00.559266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:00.571185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810883ba-305b-4350-8512-48d48563f2ab admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:00.576125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee46136-50f3-4bbc-9190-9da61f014388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:00.576830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46136-50f3-4bbc-9190-9da61f014388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:00.577109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46136-50f3-4bbc-9190-9da61f014388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:00.577387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee46136-50f3-4bbc-9190-9da61f014388 admin admin] PATH_INFO: `/v3/projects/39921738f8cf4304b2b27a54df35ddc5/users/9c4b50cd24bc4f7897456cb39f3591c1/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:00.579408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee46136-50f3-4bbc-9190-9da61f014388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39921738f8cf4304b2b27a54df35ddc5, user_id=9c4b50cd24bc4f7897456cb39f3591c1, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.582191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee46136-50f3-4bbc-9190-9da61f014388 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.592986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 980/1933] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:00 2022] PUT /identity/v3/projects/39921738f8cf4304b2b27a54df35ddc5/users/9c4b50cd24bc4f7897456cb39f3591c1/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:00.612241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710ef54-1213-49f2-ac7d-dffb38ca22ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:00.613722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710ef54-1213-49f2-ac7d-dffb38ca22ea service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:00.623824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 954/1934] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:01.831909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:01.832813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:01.833231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:01.901792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] MFA Rules not processed for user `9c4b50cd24bc4f7897456cb39f3591c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:01.906820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:02.051337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 981/1935] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:02.061516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:02.062030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:02.062030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:02.083559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] MFA Rules not processed for user `7922bca503bf423d9796cec2106df14e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:02.084688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:02.170769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 955/1936] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:02.186610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:02.188211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:02.312194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fda16a-fd9f-4387-9087-b51237cbaca8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:02.320996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7988b-29ae-44e7-85b2-c7c349e9a209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:02.321990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7988b-29ae-44e7-85b2-c7c349e9a209 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:02.322514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7988b-29ae-44e7-85b2-c7c349e9a209 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:02.323080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7988b-29ae-44e7-85b2-c7c349e9a209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:02.336797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7988b-29ae-44e7-85b2-c7c349e9a209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:02.338855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7988b-29ae-44e7-85b2-c7c349e9a209 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:02.346579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:02.359342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 982/1937] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:02.411418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:02.561197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdb535-28f4-43ae-b792-0f0630623c2d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:02.569149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:02.570034 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:02.570522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:02.570938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] PATH_INFO: `/v3/users/9cc6e234afa34a809338c40499e0db3b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:02.578898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc6e234afa34a809338c40499e0db3b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:02.581785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:02.678196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc6e234afa34a809338c40499e0db3b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:02.688136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc6e234afa34a809338c40499e0db3b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:02.689362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc6e234afa34a809338c40499e0db3b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:02.691017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc6e234afa34a809338c40499e0db3b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:02.705064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc6e234afa34a809338c40499e0db3b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:02.734345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 956/1938] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:02 2022] DELETE /identity/v3/users/9cc6e234afa34a809338c40499e0db3b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:02.738734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:02.739027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:02.739311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:02.762001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:02.763667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:02.794655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:02.845881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 983/1939] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:02.856237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:02.858978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:02.925632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb771a-5193-4c34-8b7d-80db4a58376b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:02.929360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61492432-3fa9-46bb-8f76-781475fb65dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:02.930012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492432-3fa9-46bb-8f76-781475fb65dc service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:02.930287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492432-3fa9-46bb-8f76-781475fb65dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:02.930555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61492432-3fa9-46bb-8f76-781475fb65dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:02.940768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61492432-3fa9-46bb-8f76-781475fb65dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:02.943165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61492432-3fa9-46bb-8f76-781475fb65dc service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:02.958392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 957/1940] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:03.559318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:03.560906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:03.575672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f7385-41d4-4655-9392-13e1df7b7834 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:03.581295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:03.582568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:03.582965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:03.583309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] PATH_INFO: `/v3/projects/6a393a312b2f49c2900b1ff8ac100287` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:03.584872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a393a312b2f49c2900b1ff8ac100287)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:03.587665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:03.698189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a393a312b2f49c2900b1ff8ac100287', 'request_id': 'req-166f3b44-2454-4431-8fa5-a876647d321f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:03.714366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a393a312b2f49c2900b1ff8ac100287', 'request_id': 'req-166f3b44-2454-4431-8fa5-a876647d321f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:03.746240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a393a312b2f49c2900b1ff8ac100287', 'request_id': 'req-166f3b44-2454-4431-8fa5-a876647d321f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:03.768935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] The token cache is being invalidate because project 6a393a312b2f49c2900b1ff8ac100287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:03.769501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:03.770982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:03.779690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 984/1941] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:03 2022] DELETE /identity/v3/projects/6a393a312b2f49c2900b1ff8ac100287 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:03.780779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba19cf-0f7b-4d3b-bd33-f940f1ae4cbd None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:03.781263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba19cf-0f7b-4d3b-bd33-f940f1ae4cbd None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:03.781263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba19cf-0f7b-4d3b-bd33-f940f1ae4cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:03.812499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-57ba19cf-0f7b-4d3b-bd33-f940f1ae4cbd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:03.813990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-57ba19cf-0f7b-4d3b-bd33-f940f1ae4cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:03.859853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:03.861967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:03.889017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:03.932689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 958/1942] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:03.941775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:03.942318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:03.942788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:03.993892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f3b44-2454-4431-8fa5-a876647d321f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.001151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.002093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.002439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.002821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] PATH_INFO: `/v3/users/f887f137ffc843acb7633ef2514fba6c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.004453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f887f137ffc843acb7633ef2514fba6c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.006325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.009309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:04.014537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:04.040643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 959/1943] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:04.045505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.087089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d51b0-36f6-45c7-a99c-e916a707735c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.093088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.093951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.094450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.094928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.095761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:04.096374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.098247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.123813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f887f137ffc843acb7633ef2514fba6c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.124011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 960/1944] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:04.124892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.138519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97214-69d0-4b84-83cd-5365e9a9e1bc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.142381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f887f137ffc843acb7633ef2514fba6c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.143174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f887f137ffc843acb7633ef2514fba6c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.143977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f887f137ffc843acb7633ef2514fba6c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.144168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.146051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:04.147713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.149646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.149933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.150701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.156809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.163577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3c0eb00b-85a4-4432-8144-a37d590150a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f887f137ffc843acb7633ef2514fba6c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.206589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 985/1945] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:03 2022] DELETE /identity/v3/users/f887f137ffc843acb7633ef2514fba6c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:04.209581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.209870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.210369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.218734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 961/1946] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:04 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:04.225591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.230080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:04.259550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:04.261250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:04.338868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 986/1947] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:04.349030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.350972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:04.363172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855080-c963-41b8-bdbf-0835328df258 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.378025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.378908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.379260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.379661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.380387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.383765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.428557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 962/1948] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:04 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:04.434936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.447839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585226a6-fecf-4a51-ad60-789cdf341ff1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.453812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.455013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.455309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.455590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.456249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.458268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.471710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8e6b5-94a6-4585-a956-612b81058ec2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.476682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 963/1949] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:04.477930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.481561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.482395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.482783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.483202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.489463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1461452-6ebb-45c3-8c0a-ceca60f5fe65 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.495632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.496679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8c00f-754c-4f30-9967-96908dd0e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.497324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8c00f-754c-4f30-9967-96908dd0e763 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.497432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.497594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8c00f-754c-4f30-9967-96908dd0e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.497880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8c00f-754c-4f30-9967-96908dd0e763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.498558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8c00f-754c-4f30-9967-96908dd0e763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.500231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8c00f-754c-4f30-9967-96908dd0e763 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.511292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 987/1950] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:59:04.520655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 964/1951] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:04.525934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.537476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24ae4-56ef-49a7-913a-5a1514dd56b2 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.543068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.543801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.544082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.544355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] PATH_INFO: `/v3/projects/01410cbe7e5945778267a156391df652/users/1bd4f356d39a44d7b459085e3650f6b3/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.563279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01410cbe7e5945778267a156391df652, user_id=1bd4f356d39a44d7b459085e3650f6b3, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.565498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.580293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 988/1952] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:04 2022] PUT /identity/v3/projects/01410cbe7e5945778267a156391df652/users/1bd4f356d39a44d7b459085e3650f6b3/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:04.585510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.585699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.585973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.606839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:04.608052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:04.699920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 965/1953] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:04.715143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.786871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba08af5-fd83-45df-8587-0bb296424538 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.792247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.793343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.793839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.794327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.802229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:04.806883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.809391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.820903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 989/1954] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:04.829466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:04.833380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:04.867961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5683533e-a289-424e-987e-a7731c8c79d8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:04.876643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:04.877524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:04.877949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:04.878365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] PATH_INFO: `/v3/projects/a3fe7ce867734f5eb35b2f6c7e6b9a01` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:04.880953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fe7ce867734f5eb35b2f6c7e6b9a01)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:04.883095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:04.886052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:04.945110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fe7ce867734f5eb35b2f6c7e6b9a01', 'request_id': 'req-3512f20e-4df7-45e2-ad51-a35e0bde81bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.955570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fe7ce867734f5eb35b2f6c7e6b9a01', 'request_id': 'req-3512f20e-4df7-45e2-ad51-a35e0bde81bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.965264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fe7ce867734f5eb35b2f6c7e6b9a01', 'request_id': 'req-3512f20e-4df7-45e2-ad51-a35e0bde81bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.981329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] The token cache is being invalidate because project a3fe7ce867734f5eb35b2f6c7e6b9a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:04.981647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.982860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:04.984489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 966/1955] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:04 2022] DELETE /identity/v3/projects/a3fe7ce867734f5eb35b2f6c7e6b9a01 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:04.989280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:05.000475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673946c-d57c-40bb-8e49-ecd046b0977e service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:05.077278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:05.077930 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:05.078209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:05.078533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] PATH_INFO: `/v3/users/db4a81e739f74179a0d033b9201a727d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:05.080051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4a81e739f74179a0d033b9201a727d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:05.082011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:05.141600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4a81e739f74179a0d033b9201a727d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:05.153901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4a81e739f74179a0d033b9201a727d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:05.155585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4a81e739f74179a0d033b9201a727d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:05.156457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4a81e739f74179a0d033b9201a727d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:05.166284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8bfcc785-c406-456d-ad03-8d7a323316c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4a81e739f74179a0d033b9201a727d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:05.197550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 990/1956] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:04 2022] DELETE /identity/v3/users/db4a81e739f74179a0d033b9201a727d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:05.888966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:05.890769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:05.907478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512f20e-4df7-45e2-ad51-a35e0bde81bd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.018568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.019540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.019880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.020880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] PATH_INFO: `/v3/projects/4c79c65835d94ac99e437e63e585ac3f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.022192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c79c65835d94ac99e437e63e585ac3f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.031157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.135913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c79c65835d94ac99e437e63e585ac3f', 'request_id': 'req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:06.143544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c79c65835d94ac99e437e63e585ac3f', 'request_id': 'req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:06.157170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c79c65835d94ac99e437e63e585ac3f', 'request_id': 'req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:06.172234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] The token cache is being invalidate because project 4c79c65835d94ac99e437e63e585ac3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:06.172699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:06.173641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5a7657a7-7cf6-46d6-8fe5-1f8f00b79e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:06.175899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 967/1957] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:05 2022] DELETE /identity/v3/projects/4c79c65835d94ac99e437e63e585ac3f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:06.184250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.184250 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.184947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.230774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:06.232213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:06.338283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 991/1958] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:06.345836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.346116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.346430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.386615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:06.387890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:06.408523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 968/1959] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:06.413764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:06.445884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c5e0e-911a-433f-b6b6-c3a10d57e0a6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.458592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.459494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.459922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.460363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.461203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:06.461671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.464048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.474767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:06.478791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 992/1960] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:06.484116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:06.497526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f224764-2501-46a8-b363-bdca30fde5f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.507491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.508130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.508405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.509577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.509577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.512010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.531244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:06.550127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 969/1961] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:06 2022] POST /identity/v3/projects => generated 391 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:06.555699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:06.567432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280aeb-519d-48ec-9381-a337632f532f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.639403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.640139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.640637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.640981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.641700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.643804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.669817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 993/1962] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:06 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:06.673823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:06.688220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728edd82-9827-488b-9077-76f927cbea18 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.693742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.694349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.694918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.695202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.695850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.699362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.717958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 970/1963] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:06.721668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:06.733526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02497ee4-c779-443a-8fa2-bc222e1c21a6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.751847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce81d2-3530-4561-8403-207d674e0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.753965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce81d2-3530-4561-8403-207d674e0d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.754470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce81d2-3530-4561-8403-207d674e0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.755389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce81d2-3530-4561-8403-207d674e0d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.756252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce81d2-3530-4561-8403-207d674e0d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.776494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce81d2-3530-4561-8403-207d674e0d03 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.808606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 994/1964] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:06.813151 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:06.826790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e1f93-1ae1-4ef5-a54b-5b160d37ab0e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:06.832568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:06.833313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.833589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.833864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] PATH_INFO: `/v3/projects/87494b28743e4d6d9233f42c595f3b4c/users/917a62cf4cd242fdb7429ea8adff75f0/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.851163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87494b28743e4d6d9233f42c595f3b4c, user_id=917a62cf4cd242fdb7429ea8adff75f0, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:06.855024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:06.874500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 971/1965] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:06 2022] PUT /identity/v3/projects/87494b28743e4d6d9233f42c595f3b4c/users/917a62cf4cd242fdb7429ea8adff75f0/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:06.885818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:06.886688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:06.887108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:06.971275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] MFA Rules not processed for user `917a62cf4cd242fdb7429ea8adff75f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:06.972490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:07.121859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 995/1966] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:07.126190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.227585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c6f71-d897-42f4-b780-99fdc9f2f10e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.233382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.234017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.234330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.234556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.235208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.237278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:07.277099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 972/1967] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:07 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:07.278880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.295010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c98e7-06ce-4004-9a2d-6cc1bddda609 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.368789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.369650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.370118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.370950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.371815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.373804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:07.396728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:07.412884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 996/1968] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:07 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:07.416986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.477210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e49da1-47fb-4e3c-bf23-057789bd1de2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.482354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.482980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.483257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.483527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.484172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.485832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:07.507599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 973/1969] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:07.511585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.522912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eed72-77e3-4a0d-9198-4089b2acbd38 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.535228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.536272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.536556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.536857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] PATH_INFO: `/v3/projects/09ed106194bf4313ae6cf01c1ba0a171/users/663d2c5d810d4557bfed32f08fc47f90/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.561697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ed106194bf4313ae6cf01c1ba0a171, user_id=663d2c5d810d4557bfed32f08fc47f90, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.565674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:07.591585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 997/1970] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:07 2022] PUT /identity/v3/projects/09ed106194bf4313ae6cf01c1ba0a171/users/663d2c5d810d4557bfed32f08fc47f90/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:07.595631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.606653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813a00a-d3e6-42d0-9643-9f9ae3bf3060 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.668256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ef9b-487b-42fc-ab1a-7b28f42e46c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.669123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ef9b-487b-42fc-ab1a-7b28f42e46c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.669457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ef9b-487b-42fc-ab1a-7b28f42e46c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.669790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ef9b-487b-42fc-ab1a-7b28f42e46c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.670569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ef9b-487b-42fc-ab1a-7b28f42e46c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.672333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ef9b-487b-42fc-ab1a-7b28f42e46c3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:07.683273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 974/1971] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:07.687575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.699044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c03c3-f394-42dd-b084-0bb234f0ae1e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.704103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.704856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.705132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.705404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] PATH_INFO: `/v3/projects/09ed106194bf4313ae6cf01c1ba0a171/users/663d2c5d810d4557bfed32f08fc47f90/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.707454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ed106194bf4313ae6cf01c1ba0a171, user_id=663d2c5d810d4557bfed32f08fc47f90, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.710190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:07.728500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 998/1972] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:07 2022] PUT /identity/v3/projects/09ed106194bf4313ae6cf01c1ba0a171/users/663d2c5d810d4557bfed32f08fc47f90/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:07.733096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.733405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.733652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.765357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] MFA Rules not processed for user `663d2c5d810d4557bfed32f08fc47f90`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:07.766587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:07.785166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:07.869291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 975/1973] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:07.876814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:07.879004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:07.981049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb464-9381-4108-8b15-cdb3400bc953 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:07.985017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:07.985711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:07.985992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:07.986261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:07.997555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:07.999017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:08.011056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 999/1974] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:08.079925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:08.088684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:08.101268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb121ec-148c-486c-85be-0ab8224d7448 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:08.105473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0c2fe-dee0-44f8-b288-045ac896f1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:08.106243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c2fe-dee0-44f8-b288-045ac896f1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:08.106722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c2fe-dee0-44f8-b288-045ac896f1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:08.106901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0c2fe-dee0-44f8-b288-045ac896f1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:08.227011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c2fe-dee0-44f8-b288-045ac896f1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:08.228563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0c2fe-dee0-44f8-b288-045ac896f1a9 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:08.252463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 976/1975] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:12.383378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:12.550498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b596f85f-e121-49d4-941f-dcc450290e8f service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:12.567594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:12.568318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:12.568599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:12.568906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] PATH_INFO: `/v3/users/917a62cf4cd242fdb7429ea8adff75f0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:12.570176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917a62cf4cd242fdb7429ea8adff75f0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:12.574453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:12.718267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917a62cf4cd242fdb7429ea8adff75f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:12.736594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917a62cf4cd242fdb7429ea8adff75f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:12.738102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917a62cf4cd242fdb7429ea8adff75f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:12.738972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917a62cf4cd242fdb7429ea8adff75f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:12.751864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917a62cf4cd242fdb7429ea8adff75f0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:12.755918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:12.804065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1000/1976] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:12 2022] DELETE /identity/v3/users/917a62cf4cd242fdb7429ea8adff75f0 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:12.808743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795894dc-4a64-4626-a412-363e497a08e7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:12.809633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795894dc-4a64-4626-a412-363e497a08e7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:12.810062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795894dc-4a64-4626-a412-363e497a08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:12.830975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-795894dc-4a64-4626-a412-363e497a08e7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:12.832689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-795894dc-4a64-4626-a412-363e497a08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:12.950063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 977/1977] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:12.994115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:12.996025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:13.112978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4e58f-1895-487d-9f0c-bede60bd5eb8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.117170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.117964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.118418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.118697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.129974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.131589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.143020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1001/1978] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:13.215943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.217096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.217399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.273788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] MFA Rules not processed for user `1bd4f356d39a44d7b459085e3650f6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:13.275387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:13.330381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:13.362337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 978/1979] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:13.367178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.368670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:13.386441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35133cb-4a44-40f4-bf52-0a64abf87d57 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.394003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.394249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.394631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.394912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.395553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.397755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.429077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1002/1980] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:13 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:13.436562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.457273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e60a8-df55-4f58-a6c5-606c988cd60e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.550638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.551303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.551583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.551867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.552516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.555793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.588965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 979/1981] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:13 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:13.592757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.610364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20dbe5-a225-4880-a697-f113b6535325 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.619329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.620998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.621124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.622466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.623169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.626530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.645791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1003/1982] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:13.649806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.662899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f0563-cfd9-4ad1-8bd2-76922b888279 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.668439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.669196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.669439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.669709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] PATH_INFO: `/v3/projects/f229d693305c4c4986e1cae622cf37c9/users/d16d42382a084c108e5adb5c953e53a3/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.697588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f229d693305c4c4986e1cae622cf37c9, user_id=d16d42382a084c108e5adb5c953e53a3, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.700641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.722227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 980/1983] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:13 2022] PUT /identity/v3/projects/f229d693305c4c4986e1cae622cf37c9/users/d16d42382a084c108e5adb5c953e53a3/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:13.725860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.748571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee46480-f3e2-45fc-acfb-960e542b24d5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.840955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.842507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.844967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.845305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.845973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.850701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.865668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1004/1984] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:13.870039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.885755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324083f-4216-4029-a8cf-10329ffe64cc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.887747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:13.889737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:13.891621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.892526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.893032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.893541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] PATH_INFO: `/v3/projects/f229d693305c4c4986e1cae622cf37c9/users/d16d42382a084c108e5adb5c953e53a3/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.896054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f229d693305c4c4986e1cae622cf37c9, user_id=d16d42382a084c108e5adb5c953e53a3, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.899514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.903702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eafd9b-e95c-44d8-aaff-c631becc5c26 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:13.908423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:13.909259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:13.909599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:13.909880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] PATH_INFO: `/v3/projects/87494b28743e4d6d9233f42c595f3b4c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:13.911025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87494b28743e4d6d9233f42c595f3b4c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:13.913382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:13.915825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 981/1985] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:13 2022] PUT /identity/v3/projects/f229d693305c4c4986e1cae622cf37c9/users/d16d42382a084c108e5adb5c953e53a3/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:14.021504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:14.025805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87494b28743e4d6d9233f42c595f3b4c', 'request_id': 'req-6c8168ea-13fb-42f8-9603-8a8798098341'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.041807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87494b28743e4d6d9233f42c595f3b4c', 'request_id': 'req-6c8168ea-13fb-42f8-9603-8a8798098341'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.054800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87494b28743e4d6d9233f42c595f3b4c', 'request_id': 'req-6c8168ea-13fb-42f8-9603-8a8798098341'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.068150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] The token cache is being invalidate because project 87494b28743e4d6d9233f42c595f3b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:14.069257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.069468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.074345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1005/1986] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:13 2022] DELETE /identity/v3/projects/87494b28743e4d6d9233f42c595f3b4c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:14.075380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:14.077173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:14.195222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b20bc-ce8a-496b-a7d1-4c58ba1b2a14 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:14.307697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:14.328808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:14.329509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:14.329787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:14.330102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] PATH_INFO: `/v3/users/663d2c5d810d4557bfed32f08fc47f90` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:14.348537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663d2c5d810d4557bfed32f08fc47f90)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:14.355637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:14.455349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663d2c5d810d4557bfed32f08fc47f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.471259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663d2c5d810d4557bfed32f08fc47f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.473118 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663d2c5d810d4557bfed32f08fc47f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.474278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663d2c5d810d4557bfed32f08fc47f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.486287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-60d3ff63-5773-425e-b9f3-0182172ed333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663d2c5d810d4557bfed32f08fc47f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:14.515664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 982/1987] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:14 2022] DELETE /identity/v3/users/663d2c5d810d4557bfed32f08fc47f90 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:14.876763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:14.890270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8168ea-13fb-42f8-9603-8a8798098341 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:14.982561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:14.983881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:14.984340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:14.985055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] PATH_INFO: `/v3/projects/09ed106194bf4313ae6cf01c1ba0a171` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:14.987169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ed106194bf4313ae6cf01c1ba0a171)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:14.991415 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.075817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ed106194bf4313ae6cf01c1ba0a171', 'request_id': 'req-08c1619c-406f-47b7-b4b6-675c88e6d866'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:15.084550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ed106194bf4313ae6cf01c1ba0a171', 'request_id': 'req-08c1619c-406f-47b7-b4b6-675c88e6d866'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:15.097132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ed106194bf4313ae6cf01c1ba0a171', 'request_id': 'req-08c1619c-406f-47b7-b4b6-675c88e6d866'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:15.118667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] The token cache is being invalidate because project 09ed106194bf4313ae6cf01c1ba0a171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:15.119365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:15.121227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-08c1619c-406f-47b7-b4b6-675c88e6d866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:15.124202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1006/1988] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:14 2022] DELETE /identity/v3/projects/09ed106194bf4313ae6cf01c1ba0a171 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:15.131506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.131506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.132014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.156676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:15.158296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:15.236025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 983/1989] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:15.243679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.243964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.244248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.267651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:15.269063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:15.282080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1007/1990] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:15.283480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.307735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84d65b-4522-416a-a3f3-d8df0f509fd3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.314420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.315290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.315631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.315990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.316815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:15.317113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.318888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.335122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 984/1991] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:59:15.337130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.352480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c43d-f6c6-494f-aa49-0a721faa5491 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.358360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.358988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.359263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.359529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.360170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.362148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.414345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1008/1992] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:15 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:15.419669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.433338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dde92-37fd-487e-8bee-4f12d9e94807 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.503581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:15.537900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.538543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.538819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.539087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.539759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.542137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.585125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 985/1993] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:15 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:15.589784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.605178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a34e56-3bc6-4f36-8b98-cdde9c14b52c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.623935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.624592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.626268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.626268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.626268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.627468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.651489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.652573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1009/1994] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:15.667865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba52fcd-571f-48f3-9b66-2e5888986c37 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.695441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfc9e0-49bd-4ef2-ad68-1b0aadb84c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.697177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfc9e0-49bd-4ef2-ad68-1b0aadb84c32 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.697446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfc9e0-49bd-4ef2-ad68-1b0aadb84c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.698399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfc9e0-49bd-4ef2-ad68-1b0aadb84c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.699092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfc9e0-49bd-4ef2-ad68-1b0aadb84c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.705402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfc9e0-49bd-4ef2-ad68-1b0aadb84c32 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.721966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 986/1995] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:15.727012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:15.739565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf093a-d127-4e5a-9232-228a6063fd4e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:15.747174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:15.748187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.748837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.748837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] PATH_INFO: `/v3/projects/2aef7efc629f40f091668e137d77a882/users/622e27781f5946919ebba747aaf241fd/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.773031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aef7efc629f40f091668e137d77a882, user_id=622e27781f5946919ebba747aaf241fd, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:15.775889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:15.793826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:15.802826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1010/1996] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:15 2022] PUT /identity/v3/projects/2aef7efc629f40f091668e137d77a882/users/622e27781f5946919ebba747aaf241fd/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:15.818470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:15.818758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:15.819334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:15.851902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] MFA Rules not processed for user `622e27781f5946919ebba747aaf241fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:15.853461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:15.947451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 987/1997] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:15.952304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.058354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005893-2e95-4758-8099-97614a3c4927 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.067105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.068107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.068380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.068710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.069341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.071244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.121396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1011/1998] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:15 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:16.122211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.133693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707abb15-0fe4-4b9f-ab8d-5c3b4e579c3c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.257749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.258652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.259133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.259742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.260838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.263040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.303244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 988/1999] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:16 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:16.305655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.324518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e638d3-8262-4007-9296-f33d185d70c6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.333122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.333910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.334593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.334593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.335542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.339295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.395387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1012/2000] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:16.396735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.429843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5344b8b-87e8-4d3c-bfda-625fc2711a1a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.445396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.450175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.451148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.451914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] PATH_INFO: `/v3/projects/25b7aa73b0564a5e9b956ce379394642/users/ec8be1908265411f9351580f8d15e007/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.484225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b7aa73b0564a5e9b956ce379394642, user_id=ec8be1908265411f9351580f8d15e007, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.487410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.530508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 989/2001] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:16 2022] PUT /identity/v3/projects/25b7aa73b0564a5e9b956ce379394642/users/ec8be1908265411f9351580f8d15e007/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:16.536862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.555396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87cacc-fdd8-45bb-9cfd-c790c96acb22 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.654099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5d37f-0a64-43a6-ae9e-325e4ef27341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.655001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5d37f-0a64-43a6-ae9e-325e4ef27341 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.655283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5d37f-0a64-43a6-ae9e-325e4ef27341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.655551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5d37f-0a64-43a6-ae9e-325e4ef27341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.656195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5d37f-0a64-43a6-ae9e-325e4ef27341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.662235 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5d37f-0a64-43a6-ae9e-325e4ef27341 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.680424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.681557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1013/2002] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:16.695173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba6ecf-3bcb-48b9-a090-d14f242049b2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:16.704420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:16.705153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.705515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.705840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] PATH_INFO: `/v3/projects/25b7aa73b0564a5e9b956ce379394642/users/ec8be1908265411f9351580f8d15e007/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.709244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b7aa73b0564a5e9b956ce379394642, user_id=ec8be1908265411f9351580f8d15e007, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:16.712229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:16.731017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 990/2003] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:16 2022] PUT /identity/v3/projects/25b7aa73b0564a5e9b956ce379394642/users/ec8be1908265411f9351580f8d15e007/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:16.745123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:16.745649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:16.746144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:16.783670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] MFA Rules not processed for user `ec8be1908265411f9351580f8d15e007`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:16.785980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:16.889958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:16.905079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1014/2004] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:16.919548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:16.921708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:16.946379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:17.082804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b1fa4-6bce-44fd-8e01-9ac53ccdcd64 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:17.098409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04415ad6-e744-4020-8c74-06bb6198fc98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:17.099057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415ad6-e744-4020-8c74-06bb6198fc98 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:17.099329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415ad6-e744-4020-8c74-06bb6198fc98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:17.099593 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04415ad6-e744-4020-8c74-06bb6198fc98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:17.115839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415ad6-e744-4020-8c74-06bb6198fc98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:17.118042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04415ad6-e744-4020-8c74-06bb6198fc98 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:17.131219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 991/2005] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:17.652502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:17.740311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befec9b8-b284-432e-981b-0b0ca584a673 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:17.749397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:17.750181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:17.750535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:17.750874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] PATH_INFO: `/v3/users/622e27781f5946919ebba747aaf241fd` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:17.752450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=622e27781f5946919ebba747aaf241fd)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:17.754595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:17.831266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622e27781f5946919ebba747aaf241fd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:17.845366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622e27781f5946919ebba747aaf241fd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:17.846820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622e27781f5946919ebba747aaf241fd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:17.849925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622e27781f5946919ebba747aaf241fd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:17.870904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622e27781f5946919ebba747aaf241fd'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:17.905799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1015/2006] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:17 2022] DELETE /identity/v3/users/622e27781f5946919ebba747aaf241fd => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:17.912269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8a98-45b3-45c0-bd98-957d1acbcf35 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:17.912718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8a98-45b3-45c0-bd98-957d1acbcf35 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:17.912916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8a98-45b3-45c0-bd98-957d1acbcf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:17.990704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-26ab8a98-45b3-45c0-bd98-957d1acbcf35 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:17.993925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-26ab8a98-45b3-45c0-bd98-957d1acbcf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:18.102058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 992/2007] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:18.108965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:18.110406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:18.243035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00056f87-48bb-4604-88fd-080f6027b68a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:18.256404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a515edf-4125-4e94-b226-a900e9b71799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:18.257228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a515edf-4125-4e94-b226-a900e9b71799 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:18.257514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a515edf-4125-4e94-b226-a900e9b71799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:18.257798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a515edf-4125-4e94-b226-a900e9b71799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:18.278014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a515edf-4125-4e94-b226-a900e9b71799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:18.279521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a515edf-4125-4e94-b226-a900e9b71799 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:18.299541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1016/2008] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:18.546156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0033-7cbb-4533-9627-2ef64352e02f None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:18.546591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0033-7cbb-4533-9627-2ef64352e02f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:18.546986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b0033-7cbb-4533-9627-2ef64352e02f None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:18.548466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 993/2009] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:59:18.557966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:18.558799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:18.559241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:18.594409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:18.595674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:18.608078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:18.721000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1017/2010] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:59:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:18.766639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0033-7cbb-4533-9627-2ef64352e02f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:18.769574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-027b0033-7cbb-4533-9627-2ef64352e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:18.772775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:18.774231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:18.800303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad9d35-cfcc-4ece-b242-88d6457651cb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:18.803764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b0033-7cbb-4533-9627-2ef64352e02f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:18.816282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80080c-6273-476a-b211-d009b247719e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:18.816971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80080c-6273-476a-b211-d009b247719e service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:18.817249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80080c-6273-476a-b211-d009b247719e service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:18.817517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80080c-6273-476a-b211-d009b247719e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:18.825835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:18.826483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:18.826762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:18.827030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] PATH_INFO: `/v3/users/cea89d871eb14900bb3988721446c489` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:18.829152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea89d871eb14900bb3988721446c489)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:18.831172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:18.845849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80080c-6273-476a-b211-d009b247719e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:18.850574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80080c-6273-476a-b211-d009b247719e service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:18.882486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1018/2011] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:59:18.884322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80080c-6273-476a-b211-d009b247719e service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:18.886221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bc80080c-6273-476a-b211-d009b247719e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:18.907832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80080c-6273-476a-b211-d009b247719e service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:18.914145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:18.915209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:18.915672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:18.916092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] PATH_INFO: `/v3/projects/2aef7efc629f40f091668e137d77a882` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:18.917435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea89d871eb14900bb3988721446c489'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:18.922336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aef7efc629f40f091668e137d77a882)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:18.924538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:18.940872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea89d871eb14900bb3988721446c489'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:18.941530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea89d871eb14900bb3988721446c489'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:18.942172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea89d871eb14900bb3988721446c489'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:18.951943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea89d871eb14900bb3988721446c489'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:18.994623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 994/2012] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:18 2022] DELETE /identity/v3/users/cea89d871eb14900bb3988721446c489 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:19.050791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aef7efc629f40f091668e137d77a882', 'request_id': 'req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.061017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aef7efc629f40f091668e137d77a882', 'request_id': 'req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.075823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aef7efc629f40f091668e137d77a882', 'request_id': 'req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.112977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] The token cache is being invalidate because project 2aef7efc629f40f091668e137d77a882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:19.113288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.116387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.120931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1019/2013] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:18 2022] DELETE /identity/v3/projects/2aef7efc629f40f091668e137d77a882 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:19.124681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:19.126251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:19.182640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:19.258605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6444cd2-5059-45c1-9cab-d7d5d7feead0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:19.271338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:19.273233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:19.365760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:19.367190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:19.367463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:19.367726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] PATH_INFO: `/v3/users/ec8be1908265411f9351580f8d15e007` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:19.369001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8be1908265411f9351580f8d15e007)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:19.372908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:19.414637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e89d2-4b5b-4fbc-8de4-6bb1f39d2d7c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:19.440944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:19.441675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:19.441934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:19.442253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] PATH_INFO: `/v3/projects/fb095946b94e4da2b6f90ab7eae34fdf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:19.445363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb095946b94e4da2b6f90ab7eae34fdf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:19.448570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:19.450215 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8be1908265411f9351580f8d15e007'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.462209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8be1908265411f9351580f8d15e007'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.463575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8be1908265411f9351580f8d15e007'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.464011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8be1908265411f9351580f8d15e007'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.482970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1c6d8c2a-72b0-4fee-bc84-8ddfe6ba3db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8be1908265411f9351580f8d15e007'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.494774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:19.519959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 995/2014] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:19 2022] DELETE /identity/v3/users/ec8be1908265411f9351580f8d15e007 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:19.545576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb095946b94e4da2b6f90ab7eae34fdf', 'request_id': 'req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.555416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb095946b94e4da2b6f90ab7eae34fdf', 'request_id': 'req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.570795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb095946b94e4da2b6f90ab7eae34fdf', 'request_id': 'req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.586286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] The token cache is being invalidate because project fb095946b94e4da2b6f90ab7eae34fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:19.587400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.589101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9486370b-d4e1-46aa-8dfe-34ff3f8c6843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:19.601227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1020/2015] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:19 2022] DELETE /identity/v3/projects/fb095946b94e4da2b6f90ab7eae34fdf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:19.603828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:19.604149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:19.604422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:19.634491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:19.635795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:19.719541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:19.767018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 996/2016] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:19.775352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:19.775821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:19.776343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:19.813726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:19.816445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:19.846296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1021/2017] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:19.851457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:19.883255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e08f-cfe6-4022-8bdd-f279042d31b0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:19.889569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:19.890210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:19.890481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:19.890741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:19.891395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:19.891688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:19.893450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:19.919060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 997/2018] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:19.925531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:19.943381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a928d2c-5dd1-45f6-9b22-2ec18a3a83a0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:19.949305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:19.950212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:19.950493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:19.950763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:19.951594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:19.954232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.019751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.022439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1022/2019] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:19 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:20.025969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.030906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:20.061361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efaed6-f6da-47d3-b147-51fb23c774f7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.142065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b5ff6-cad5-4dd6-bba5-1794ada1c304 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.153826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.154533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.155885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.157548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.159225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.161766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.178682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.179449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.179779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.180106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] PATH_INFO: `/v3/projects/25b7aa73b0564a5e9b956ce379394642` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.183518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b7aa73b0564a5e9b956ce379394642)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.186521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.208025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1023/2020] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:20 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:20.212338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.236992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd371c-3dfe-49c3-b4de-faa33c71a593 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.248656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.249452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.250370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.250991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.251695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.254152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.278192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1024/2021] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:20.283664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.289735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b7aa73b0564a5e9b956ce379394642', 'request_id': 'req-2c379e33-73ac-4189-b7cc-3ac697da5612'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:20.295627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5e1c0-7f55-4943-9cd1-8a104bcadda9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.296823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b7aa73b0564a5e9b956ce379394642', 'request_id': 'req-2c379e33-73ac-4189-b7cc-3ac697da5612'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:20.309996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b7aa73b0564a5e9b956ce379394642', 'request_id': 'req-2c379e33-73ac-4189-b7cc-3ac697da5612'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:20.322949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] The token cache is being invalidate because project 25b7aa73b0564a5e9b956ce379394642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:20.323857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:20.324670 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c379e33-73ac-4189-b7cc-3ac697da5612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:20.329939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 998/2022] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:20 2022] DELETE /identity/v3/projects/25b7aa73b0564a5e9b956ce379394642 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:20.331467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4aa9c-03b0-47ec-9005-8726638ad273 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.331817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4aa9c-03b0-47ec-9005-8726638ad273 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.332172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4aa9c-03b0-47ec-9005-8726638ad273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.355242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d8a4aa9c-03b0-47ec-9005-8726638ad273 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:20.356855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d8a4aa9c-03b0-47ec-9005-8726638ad273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:20.381333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.382478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.382755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.383024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.384071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.385804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.388182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:20.409028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1025/2023] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:20.412540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.415194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:20.439285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabb49f-1643-40f4-9113-125efc8b664b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.449916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3e103-18ad-4dcd-863c-2f855234a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.456353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e103-18ad-4dcd-863c-2f855234a981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.456353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e103-18ad-4dcd-863c-2f855234a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.456353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3e103-18ad-4dcd-863c-2f855234a981 admin admin] PATH_INFO: `/v3/projects/3bd8b727a5b440b9af0c1054d8a19068/users/d18201b9aac74930b8ef60f72b85fe40/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.457661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 999/2024] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:20.459490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.460023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.460433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.470065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3e103-18ad-4dcd-863c-2f855234a981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd8b727a5b440b9af0c1054d8a19068, user_id=d18201b9aac74930b8ef60f72b85fe40, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.472800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3e103-18ad-4dcd-863c-2f855234a981 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.485730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:20.487469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:20.492238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1026/2025] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:20 2022] PUT /identity/v3/projects/3bd8b727a5b440b9af0c1054d8a19068/users/d18201b9aac74930b8ef60f72b85fe40/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:20.493249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:20.498124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.498413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.498687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.531836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:20.533241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:20.571533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1000/2026] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:20.576110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.587041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfab65-d5b2-4342-9293-8c1c0432a501 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.597067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.597707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.599185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.599829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.600768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:20.601172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.603050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.620124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1001/2027] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:20.621543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.622797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1027/2028] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:20.634759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.636174 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e98228-640f-4596-a99f-c2f5da582cce admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.636768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:20.642466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.643236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.643614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.644017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.644790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.646875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.691910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1002/2029] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:20 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:20.693159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.708483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274512d-24b9-43ff-8712-4960bf1e474e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.769533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.770381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.771193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.771470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.775824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42782fb-e5b9-4362-aabf-ae984276b195 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.786840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.787101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.789018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.789294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.789560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.791195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.793866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.804168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.821527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1028/2030] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:20.842609 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1003/2031] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:20 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:20.846576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.859010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e5f9-1153-4e5f-95f1-d10f14db7ba0 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.877183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.877826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.879417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.879711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.880574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.882819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.915876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1029/2032] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:20.918335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.934387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a1012-7890-4440-9664-5fcd1aae8865 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.943143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8dc96-ea08-4d96-abf0-2c0ba048d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.943967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8dc96-ea08-4d96-abf0-2c0ba048d590 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.944777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8dc96-ea08-4d96-abf0-2c0ba048d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.945137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8dc96-ea08-4d96-abf0-2c0ba048d590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:20.945944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8dc96-ea08-4d96-abf0-2c0ba048d590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:20.947719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8dc96-ea08-4d96-abf0-2c0ba048d590 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:20.962734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1004/2033] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:20.966912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:20.978104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d9ef0-984f-4d67-ad4d-bb8b7eefcf2e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:20.984333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:20.984946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:20.985272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:20.985550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] PATH_INFO: `/v3/projects/c5b82eb05eec4147b25fa52f584bfc9e/users/fb81da2f6e2d4d14b8cb0d01b7cd464c/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.014665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b82eb05eec4147b25fa52f584bfc9e, user_id=fb81da2f6e2d4d14b8cb0d01b7cd464c, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.017537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.033187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:21.067727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1030/2034] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:20 2022] PUT /identity/v3/projects/c5b82eb05eec4147b25fa52f584bfc9e/users/fb81da2f6e2d4d14b8cb0d01b7cd464c/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:21.080156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.080951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.081436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.123631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] MFA Rules not processed for user `fb81da2f6e2d4d14b8cb0d01b7cd464c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:21.125057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:21.181831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:21.220942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:21.221780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1005/2035] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:21.323482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68320a8-dfc9-455c-bc68-a6e547001d7b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:21.329690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:21.330648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.330827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.331173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.331926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.334091 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.377916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1031/2036] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:21 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:21.381496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:21.410206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc118a-3dfd-4d4f-8b83-457b34f15bd3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:21.533866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:21.534819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.535234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.535811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.536590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.538948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.569284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:21.569541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1006/2037] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:21 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:21.583806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c521d-ad6a-4514-8471-7a45d27cf650 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:21.592976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:21.593868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.594901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.595320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.596129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.598568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.620793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1032/2038] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:21.622265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:21.646221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc0b5a-812a-4518-bc92-e7c68c5c69d8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:21.657211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22f033-c3b8-4e99-a52c-f987cdbd3fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:21.658106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f033-c3b8-4e99-a52c-f987cdbd3fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.658579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f033-c3b8-4e99-a52c-f987cdbd3fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.658967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22f033-c3b8-4e99-a52c-f987cdbd3fa2 admin admin] PATH_INFO: `/v3/projects/251fce01309c472e9708d2dcde9551fb/users/e0a34c1b18ed4909803314c91bdc8776/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.684564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f033-c3b8-4e99-a52c-f987cdbd3fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251fce01309c472e9708d2dcde9551fb, user_id=e0a34c1b18ed4909803314c91bdc8776, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.688385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22f033-c3b8-4e99-a52c-f987cdbd3fa2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.715595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1007/2039] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:21 2022] PUT /identity/v3/projects/251fce01309c472e9708d2dcde9551fb/users/e0a34c1b18ed4909803314c91bdc8776/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:21.719927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:21.746265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f79f2-8b34-49a7-b10f-23eb2bc6b17d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:21.812795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.813487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.814085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.850760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] MFA Rules not processed for user `d18201b9aac74930b8ef60f72b85fe40`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:21.852653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:21.853382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.853736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.853906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.855154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.855578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:21.857311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.872490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1033/2040] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:21.877433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:21.890994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3295c1-5194-4060-afc1-b9d85042fd07 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:21.897468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3387-1781-429e-b18f-59a474681d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:21.898381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3387-1781-429e-b18f-59a474681d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.899586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3387-1781-429e-b18f-59a474681d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.900014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3387-1781-429e-b18f-59a474681d20 admin admin] PATH_INFO: `/v3/projects/251fce01309c472e9708d2dcde9551fb/users/e0a34c1b18ed4909803314c91bdc8776/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.902665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c3387-1781-429e-b18f-59a474681d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251fce01309c472e9708d2dcde9551fb, user_id=e0a34c1b18ed4909803314c91bdc8776, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:21.906061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c3387-1781-429e-b18f-59a474681d20 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:21.950978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1034/2041] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:21 2022] PUT /identity/v3/projects/251fce01309c472e9708d2dcde9551fb/users/e0a34c1b18ed4909803314c91bdc8776/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:21.961820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:21.962882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:21.963334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:21.974774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1008/2042] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:21.980969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.008173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5eaed-22ca-4c18-b18f-728468d52fb1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.011413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] MFA Rules not processed for user `e0a34c1b18ed4909803314c91bdc8776`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:22.014021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.089213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:22.137405 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:22.150526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.151982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.152256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.152522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.153201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.155928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.193147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1035/2043] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:22.210180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1009/2044] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:21 2022] POST /identity/v3/projects => generated 405 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:22.214530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.216173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.222590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.354061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2c482-60fc-4e16-9f4e-b039e027bda2 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.364036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc7ff-2131-4419-8ab4-0a40f8c17e77 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.372877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf905f8-7052-4abb-a820-0a6738ecf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.373513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf905f8-7052-4abb-a820-0a6738ecf631 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.374118 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf905f8-7052-4abb-a820-0a6738ecf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.374389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf905f8-7052-4abb-a820-0a6738ecf631 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.375038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf905f8-7052-4abb-a820-0a6738ecf631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.377177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf905f8-7052-4abb-a820-0a6738ecf631 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.407122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1010/2045] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:22 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:22.409831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.410290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.410711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.433441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.434106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.434403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.434642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.447438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] MFA Rules not processed for user `d16d42382a084c108e5adb5c953e53a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:22.448971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.525581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.527118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.538461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1036/2046] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:22.539459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.549835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd50c00-c3b1-435f-9e3f-a77b5f4bb913 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.553016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1011/2047] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:22.554772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.555388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.555659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.555927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.556567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.558370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.569816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1037/2048] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:22.570114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.571548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.575617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.586231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe2c3e1-b99d-410f-b0f0-ddb4fe2e48f2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.591689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.593342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.593766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.594198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] PATH_INFO: `/v3/projects/c82b06f24b97436f9c447d249a199be6/users/69ff92bbcaa746c9acdd9378e1fd1fa7/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.610950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82b06f24b97436f9c447d249a199be6, user_id=69ff92bbcaa746c9acdd9378e1fd1fa7, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.613989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.632843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:22.640482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1038/2049] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:22 2022] PUT /identity/v3/projects/c82b06f24b97436f9c447d249a199be6/users/69ff92bbcaa746c9acdd9378e1fd1fa7/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:22.641896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.666120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbe3e6-4041-4755-b52d-0bc3e3a35f52 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.672465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:22.742583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c641d7d-a794-4d01-87b7-850b5f58617c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.751501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.752205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.752552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.752921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.753032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.753695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.754807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.755157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:22.755269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.756276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.758298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.773516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1039/2050] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:22.777951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:22.798330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c643-5a08-4209-8488-ff18f2638a1d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:22.803610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21257f1-3b31-4095-a938-6bc7820fcc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:22.804292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21257f1-3b31-4095-a938-6bc7820fcc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:22.804599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21257f1-3b31-4095-a938-6bc7820fcc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:22.804904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21257f1-3b31-4095-a938-6bc7820fcc5c admin admin] PATH_INFO: `/v3/projects/c82b06f24b97436f9c447d249a199be6/users/69ff92bbcaa746c9acdd9378e1fd1fa7/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:22.807115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21257f1-3b31-4095-a938-6bc7820fcc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82b06f24b97436f9c447d249a199be6, user_id=69ff92bbcaa746c9acdd9378e1fd1fa7, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.810598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21257f1-3b31-4095-a938-6bc7820fcc5c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.827189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1040/2051] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:22 2022] PUT /identity/v3/projects/c82b06f24b97436f9c447d249a199be6/users/69ff92bbcaa746c9acdd9378e1fd1fa7/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:22.842463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:22.846312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ae2cc-436b-47d9-89b5-70dbda913839 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:22.859390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1012/2052] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:23.864527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6e0a-aba9-4d68-8029-aee6b29528b4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:23.865092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6e0a-aba9-4d68-8029-aee6b29528b4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:23.865190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e6e0a-aba9-4d68-8029-aee6b29528b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:23.902058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d56e6e0a-aba9-4d68-8029-aee6b29528b4 None None] MFA Rules not processed for user `69ff92bbcaa746c9acdd9378e1fd1fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:23.903624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d56e6e0a-aba9-4d68-8029-aee6b29528b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:24.005772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1041/2053] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:24.542089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482838-1c6d-4ad9-b3e2-13bd83f4647b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:24.542549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482838-1c6d-4ad9-b3e2-13bd83f4647b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:24.543074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d482838-1c6d-4ad9-b3e2-13bd83f4647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:24.579231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2d482838-1c6d-4ad9-b3e2-13bd83f4647b None None] MFA Rules not processed for user `1bd4f356d39a44d7b459085e3650f6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:24.581401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2d482838-1c6d-4ad9-b3e2-13bd83f4647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:24.662697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1013/2054] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:24.906911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39caab-f2ec-4b0a-afa0-e97187eb30dc None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:24.907455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39caab-f2ec-4b0a-afa0-e97187eb30dc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:24.907455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39caab-f2ec-4b0a-afa0-e97187eb30dc None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:24.909117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1042/2055] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:59:24.914896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:24.915171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:24.915434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:24.937880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:24.939103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:24.952472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:25.092961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1014/2056] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:25.128234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39caab-f2ec-4b0a-afa0-e97187eb30dc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:25.134513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dd39caab-f2ec-4b0a-afa0-e97187eb30dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:25.168367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39caab-f2ec-4b0a-afa0-e97187eb30dc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:25.175662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:25.176737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:25.177253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:25.177593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:25.205506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:25.208402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:25.232192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1043/2057] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:25.252862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:25.255023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:25.389799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f592219-b7a6-4888-8c3f-e58636e2b65e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:25.399494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:25.400235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:25.400518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:25.400825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:25.405231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:25.488911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:25.490636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:25.503722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1015/2058] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:25.848049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:25.947080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c3683-6966-485b-8e57-1ec4c34cf6e7 service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:25.952081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:25.952991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:25.953407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:25.954426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] PATH_INFO: `/v3/users/d18201b9aac74930b8ef60f72b85fe40` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:25.956169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18201b9aac74930b8ef60f72b85fe40)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:25.958302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:25.974734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:26.036574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18201b9aac74930b8ef60f72b85fe40'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.048814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18201b9aac74930b8ef60f72b85fe40'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.049872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18201b9aac74930b8ef60f72b85fe40'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.050800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18201b9aac74930b8ef60f72b85fe40'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.063028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18201b9aac74930b8ef60f72b85fe40'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.105125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1044/2059] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:25 2022] DELETE /identity/v3/users/d18201b9aac74930b8ef60f72b85fe40 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:26.436171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:26.464997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d554dc9-b62f-4bf5-a9f7-240200fcd62b service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:26.580787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:26.582534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:26.582940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:26.583360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] PATH_INFO: `/v3/projects/3bd8b727a5b440b9af0c1054d8a19068` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:26.585864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd8b727a5b440b9af0c1054d8a19068)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:26.588367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:26.607276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:26.667935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd8b727a5b440b9af0c1054d8a19068', 'request_id': 'req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.674693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd8b727a5b440b9af0c1054d8a19068', 'request_id': 'req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.684716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd8b727a5b440b9af0c1054d8a19068', 'request_id': 'req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.698690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] The token cache is being invalidate because project 3bd8b727a5b440b9af0c1054d8a19068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:26.699052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.700346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.701917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1016/2060] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:26 2022] DELETE /identity/v3/projects/3bd8b727a5b440b9af0c1054d8a19068 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:26.705709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:26.707876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:26.722009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566b689-1e25-456a-8da0-07aa3d6acd6d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:26.792765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:26.793583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:26.793695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:26.793933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] PATH_INFO: `/v3/users/69ff92bbcaa746c9acdd9378e1fd1fa7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:26.795072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ff92bbcaa746c9acdd9378e1fd1fa7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:26.797015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:26.850527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ff92bbcaa746c9acdd9378e1fd1fa7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.860710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ff92bbcaa746c9acdd9378e1fd1fa7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.861943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ff92bbcaa746c9acdd9378e1fd1fa7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.862579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ff92bbcaa746c9acdd9378e1fd1fa7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.871241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ff92bbcaa746c9acdd9378e1fd1fa7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:26.889835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1045/2061] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:26 2022] DELETE /identity/v3/users/69ff92bbcaa746c9acdd9378e1fd1fa7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:27.080474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.081948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:27.095633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e4f87-e677-4a32-bcd8-8a8221b4d33e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.168385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.169326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.169612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.169877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] PATH_INFO: `/v3/projects/c82b06f24b97436f9c447d249a199be6` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.171079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82b06f24b97436f9c447d249a199be6)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.173039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.228769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82b06f24b97436f9c447d249a199be6', 'request_id': 'req-5535989c-7be6-4c6b-b920-c10d45e54d52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:27.239487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82b06f24b97436f9c447d249a199be6', 'request_id': 'req-5535989c-7be6-4c6b-b920-c10d45e54d52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:27.249435 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82b06f24b97436f9c447d249a199be6', 'request_id': 'req-5535989c-7be6-4c6b-b920-c10d45e54d52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:27.262491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] The token cache is being invalidate because project c82b06f24b97436f9c447d249a199be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:27.262851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:27.263591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5535989c-7be6-4c6b-b920-c10d45e54d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:27.265712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1017/2062] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:27 2022] DELETE /identity/v3/projects/c82b06f24b97436f9c447d249a199be6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:27.265800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.267087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:27.271400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207051a-48e1-4da8-90f8-dac9ef551ae9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.271674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207051a-48e1-4da8-90f8-dac9ef551ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.271943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207051a-48e1-4da8-90f8-dac9ef551ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.282715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:27.298415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1207051a-48e1-4da8-90f8-dac9ef551ae9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:27.299870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1207051a-48e1-4da8-90f8-dac9ef551ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:27.329828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:27.347875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05aea-a433-4075-90fc-5149f34b5c9d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.389039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1018/2063] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:27.398595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.398870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.399392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.408152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.408916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.409256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.410342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.411463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:27.423356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:27.424648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:27.437800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1019/2064] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:27.447778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.459091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395cb7a-a054-4979-85cc-eb7352f5ae37 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.464534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.465197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.465470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.465807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.466372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:27.466673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.468388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.487436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1020/2065] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:27.493622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.495204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.497236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.505436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f424e9-2d25-4d9c-8468-9731c33212aa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.508083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1046/2066] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:27.511783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.512513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.512878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.513240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.513930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.516363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.555235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1021/2067] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:27 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:27.559378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.574879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087036e-8a07-41b7-8676-ff61f31b5f8a service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.650062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.650693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.651055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.651278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.651916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.653877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.681791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1047/2068] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:27 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:27.686060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.696504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595864-f40c-41c3-972a-2e1dbebd4463 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.701538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.702190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.702425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.702678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.703361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.705019 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.715279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1022/2069] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:27.719213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.726280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:27.730688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2bad5-6357-4ed7-8c9d-b985d0ee7dab admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.736743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66892da2-4469-45c6-971f-f8867d0eed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.737366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892da2-4469-45c6-971f-f8867d0eed19 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.737644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892da2-4469-45c6-971f-f8867d0eed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.737915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66892da2-4469-45c6-971f-f8867d0eed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.738568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892da2-4469-45c6-971f-f8867d0eed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.740164 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66892da2-4469-45c6-971f-f8867d0eed19 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.754278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1048/2070] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:27.758731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:27.769490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc33b3-ab2d-4316-94e6-be799a8a6f71 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:27.775095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:27.775796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.776105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.776428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] PATH_INFO: `/v3/projects/c255ddb84668411689fef6fc09dc831f/users/2c9e3a925ab74f969c196767fecb9727/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.794231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c255ddb84668411689fef6fc09dc831f, user_id=2c9e3a925ab74f969c196767fecb9727, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:27.795898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:27.829940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1023/2071] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:27 2022] PUT /identity/v3/projects/c255ddb84668411689fef6fc09dc831f/users/2c9e3a925ab74f969c196767fecb9727/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:27.831175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:27.831659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:27.831884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:27.883291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] MFA Rules not processed for user `2c9e3a925ab74f969c196767fecb9727`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:27.884656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:27.968814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1049/2072] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:27.973281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.034862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a515de-a4d2-40c4-8741-cc86042dcfbc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.040076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.040727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.041009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.041282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.041953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.043882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.072780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1024/2073] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:27 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:28.077150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.094157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0a644-480e-4526-bc37-a28bae183a3f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.157509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.158130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.158392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.158656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.159282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.161214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.189255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1050/2074] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:28 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:28.193463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.205057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07576f1c-9638-46f9-b43a-f6b6441942fa admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.210665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.211452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.211876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.212067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.212759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.214638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.228651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1025/2075] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:28.231240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.243656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673d511-e44b-424a-9141-fa35f8fad496 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.249115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.249941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.250278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.251048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] PATH_INFO: `/v3/projects/21d9988b3fdc4d19ba18d09875c1fa1d/users/f9c19646f9dd4936b754afc14b3a0484/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.266779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d9988b3fdc4d19ba18d09875c1fa1d, user_id=f9c19646f9dd4936b754afc14b3a0484, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.269638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.284517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1051/2076] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:28 2022] PUT /identity/v3/projects/21d9988b3fdc4d19ba18d09875c1fa1d/users/f9c19646f9dd4936b754afc14b3a0484/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:28.288644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.300702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47267452-e408-4d03-8c76-9e519f4ad2f4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.319119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:28.359463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6484a-cfef-4772-ab9b-8b5b2278a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.360218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6484a-cfef-4772-ab9b-8b5b2278a37c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.360563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6484a-cfef-4772-ab9b-8b5b2278a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.360967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6484a-cfef-4772-ab9b-8b5b2278a37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.362416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6484a-cfef-4772-ab9b-8b5b2278a37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.363552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6484a-cfef-4772-ab9b-8b5b2278a37c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.378230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1026/2077] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:28.382835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.393490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728f62d-d54c-4303-a340-3e22bb21b67e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.398217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.398905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.401609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.402028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] PATH_INFO: `/v3/projects/21d9988b3fdc4d19ba18d09875c1fa1d/users/f9c19646f9dd4936b754afc14b3a0484/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.404204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d9988b3fdc4d19ba18d09875c1fa1d, user_id=f9c19646f9dd4936b754afc14b3a0484, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.406988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.418939 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1052/2078] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:28 2022] PUT /identity/v3/projects/21d9988b3fdc4d19ba18d09875c1fa1d/users/f9c19646f9dd4936b754afc14b3a0484/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:28.430864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.431161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.431474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.469946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] MFA Rules not processed for user `f9c19646f9dd4936b754afc14b3a0484`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:28.471430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:28.543375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1027/2079] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:28.555615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.557707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:28.600403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:28.619759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d354ae-cd61-4805-a184-9262368b1d5c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.623913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d678446-4904-43e9-b548-27f1e6ff055e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.624518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d678446-4904-43e9-b548-27f1e6ff055e service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.624834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d678446-4904-43e9-b548-27f1e6ff055e service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.625104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d678446-4904-43e9-b548-27f1e6ff055e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.636018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d678446-4904-43e9-b548-27f1e6ff055e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.637514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d678446-4904-43e9-b548-27f1e6ff055e service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.647483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1053/2080] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:28.678046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.747481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf689c-55ee-4e5d-b2e5-a921e6c589f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:28.752210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:28.752874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.753146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.753413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] PATH_INFO: `/v3/users/2c9e3a925ab74f969c196767fecb9727` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.754552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9e3a925ab74f969c196767fecb9727)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:28.756460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:28.810237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:28.814206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9e3a925ab74f969c196767fecb9727'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:28.824573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9e3a925ab74f969c196767fecb9727'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:28.825222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9e3a925ab74f969c196767fecb9727'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:28.826499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9e3a925ab74f969c196767fecb9727'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:28.834212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9e3a925ab74f969c196767fecb9727'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:28.856042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1028/2081] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:28 2022] DELETE /identity/v3/users/2c9e3a925ab74f969c196767fecb9727 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:28.861234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:28.861585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:28.861958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:28.889547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:28.890773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:28.951827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1054/2082] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:28.962602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:28.964209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:29.044357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060182b-e21a-4b7f-9c43-0175100aca6e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:29.049602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:29.051454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:29.051813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:29.052159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:29.062549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:29.064074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:29.077624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1029/2083] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:29.411643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:29.415115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:29.428777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc25786-6164-472e-b3b8-b431fd64df24 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:29.434392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:29.435354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:29.435612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:29.435948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] PATH_INFO: `/v3/projects/c255ddb84668411689fef6fc09dc831f` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:29.437654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c255ddb84668411689fef6fc09dc831f)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:29.439681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:29.493248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c255ddb84668411689fef6fc09dc831f', 'request_id': 'req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.500916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c255ddb84668411689fef6fc09dc831f', 'request_id': 'req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.509369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c255ddb84668411689fef6fc09dc831f', 'request_id': 'req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.521731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] The token cache is being invalidate because project c255ddb84668411689fef6fc09dc831f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:29.521996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.522729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.525034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1055/2084] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:29 2022] DELETE /identity/v3/projects/c255ddb84668411689fef6fc09dc831f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:29.529355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:29.540402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833407fa-1694-45de-8bad-6fc2d6755a1c service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:29.605857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:29.606647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:29.606966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:29.607329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] PATH_INFO: `/v3/users/f9c19646f9dd4936b754afc14b3a0484` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:29.608473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c19646f9dd4936b754afc14b3a0484)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:29.610891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:29.663152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c19646f9dd4936b754afc14b3a0484'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.670799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c19646f9dd4936b754afc14b3a0484'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.671482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c19646f9dd4936b754afc14b3a0484'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.672102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c19646f9dd4936b754afc14b3a0484'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.681971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b3ddc918-5e67-412a-8780-0f22754320bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c19646f9dd4936b754afc14b3a0484'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:29.692557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:29.718966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1030/2085] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:29 2022] DELETE /identity/v3/users/f9c19646f9dd4936b754afc14b3a0484 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:30.010456 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.015980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:30.032899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a8b0-e101-4306-8b9f-cbd1e6940d92 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.097821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.098471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.098772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.099049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] PATH_INFO: `/v3/projects/21d9988b3fdc4d19ba18d09875c1fa1d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.100263 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d9988b3fdc4d19ba18d09875c1fa1d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.102202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.104917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:30.156261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d9988b3fdc4d19ba18d09875c1fa1d', 'request_id': 'req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:30.164420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d9988b3fdc4d19ba18d09875c1fa1d', 'request_id': 'req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:30.178060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d9988b3fdc4d19ba18d09875c1fa1d', 'request_id': 'req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:30.194074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] The token cache is being invalidate because project 21d9988b3fdc4d19ba18d09875c1fa1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:30.194393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:30.195120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6cd5bf43-61a8-4ea8-a444-a0ca33a775d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:30.197051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1056/2086] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:30 2022] DELETE /identity/v3/projects/21d9988b3fdc4d19ba18d09875c1fa1d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:30.201887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.202164 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.202482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.229289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:30.230721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:30.312449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1031/2087] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:30.319912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.320204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.320471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.345142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:30.346382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:30.359115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1057/2088] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:30.359607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.373767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932e7e-60b5-48a9-88bf-8849691f19a5 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.382481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.383227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.384129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.384708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.385586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:30.386444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.388391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.404607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1032/2089] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:30.409942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.420273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afece3-633b-4e75-b3ab-5eb90e7a7180 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.425672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.426812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.427223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.427674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.428406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.430519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.471902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1058/2090] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:30 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:30.476335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.486733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0ef53-afde-43b1-a213-23609e1efd99 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.550605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.551320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.551534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.551923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.552641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.554668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.580648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1033/2091] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:30 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:30.583148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.596493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaad75-0ccc-4025-a54e-af85e3ea52fd admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.602979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.604070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.604550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.605069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.606281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.608326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.632845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1059/2092] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:30.638894 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.651940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948a33-0d8a-4935-be10-41f9812a8860 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.657609 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5206329-75ed-4f68-b970-7f80d1211e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.658218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206329-75ed-4f68-b970-7f80d1211e67 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.658664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206329-75ed-4f68-b970-7f80d1211e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.659027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5206329-75ed-4f68-b970-7f80d1211e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.659697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5206329-75ed-4f68-b970-7f80d1211e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.661347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5206329-75ed-4f68-b970-7f80d1211e67 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.679617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1034/2093] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:30.682013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.693455 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251bc8-e516-4f89-a3fc-b17af06f6e2c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.698474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.699079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.699435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.699713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] PATH_INFO: `/v3/projects/ef9c67174a4f4b3cbf0edb1d4638993f/users/3f349f75766e4e67887eb75879d6bd56/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.718547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef9c67174a4f4b3cbf0edb1d4638993f, user_id=3f349f75766e4e67887eb75879d6bd56, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.721613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.739028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1060/2094] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:30 2022] PUT /identity/v3/projects/ef9c67174a4f4b3cbf0edb1d4638993f/users/3f349f75766e4e67887eb75879d6bd56/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:30.749805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.750095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.750366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.780006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] MFA Rules not processed for user `3f349f75766e4e67887eb75879d6bd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:30.781242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:30.819728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:30.846989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1035/2095] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:30.858276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:30.860121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:30.920338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158479-bf9a-4391-b8f1-dff8a7f4f96e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:30.924423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e62ed-7bd5-497f-9e60-f2499e64176d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:30.925062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e62ed-7bd5-497f-9e60-f2499e64176d service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:30.925411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e62ed-7bd5-497f-9e60-f2499e64176d service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:30.925641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e62ed-7bd5-497f-9e60-f2499e64176d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:30.934569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e62ed-7bd5-497f-9e60-f2499e64176d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:30.936010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e62ed-7bd5-497f-9e60-f2499e64176d service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:30.945047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1061/2096] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:32.603474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:32.605112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:32.676153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e910d30-e8fd-4892-ba20-01be74dd5ee8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:32.681803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:32.682460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:32.682736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:32.683004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] PATH_INFO: `/v3/users/fb81da2f6e2d4d14b8cb0d01b7cd464c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:32.684155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb81da2f6e2d4d14b8cb0d01b7cd464c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:32.686127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:32.738701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb81da2f6e2d4d14b8cb0d01b7cd464c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:32.746299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb81da2f6e2d4d14b8cb0d01b7cd464c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:32.746956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb81da2f6e2d4d14b8cb0d01b7cd464c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:32.747554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb81da2f6e2d4d14b8cb0d01b7cd464c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:32.754755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb81da2f6e2d4d14b8cb0d01b7cd464c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:32.773942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1036/2097] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:32 2022] DELETE /identity/v3/users/fb81da2f6e2d4d14b8cb0d01b7cd464c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:32.778929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:32.779451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:32.779451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:32.799497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:32.800917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:32.827854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:32.863967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1062/2098] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:32.874360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:32.875877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:32.935906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc4e61-34f0-4168-a3f9-b33c93e6a32c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:32.939936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:32.941392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:32.941392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:32.941392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:32.950675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:32.952112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:32.961841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1037/2099] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:33.255683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:33.257482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:33.280879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643382d-2e12-44fb-b2f8-64d7b6a4f074 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:33.300539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:33.301341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:33.301642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:33.301922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] PATH_INFO: `/v3/projects/c5b82eb05eec4147b25fa52f584bfc9e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:33.303123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b82eb05eec4147b25fa52f584bfc9e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:33.305152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:33.355443 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b82eb05eec4147b25fa52f584bfc9e', 'request_id': 'req-5b97befb-3360-4648-847d-c3381c1290c0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.361886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b82eb05eec4147b25fa52f584bfc9e', 'request_id': 'req-5b97befb-3360-4648-847d-c3381c1290c0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.371392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b82eb05eec4147b25fa52f584bfc9e', 'request_id': 'req-5b97befb-3360-4648-847d-c3381c1290c0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.387128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] The token cache is being invalidate because project c5b82eb05eec4147b25fa52f584bfc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:33.387413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.388057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.392661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1063/2100] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:33 2022] DELETE /identity/v3/projects/c5b82eb05eec4147b25fa52f584bfc9e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:33.394040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:33.399559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:33.406161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7165fe-a52b-4226-8e5d-435a28e899e3 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:33.467952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:33.468633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:33.468923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:33.469234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] PATH_INFO: `/v3/users/e0a34c1b18ed4909803314c91bdc8776` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:33.470405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a34c1b18ed4909803314c91bdc8776)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:33.472635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:33.523965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a34c1b18ed4909803314c91bdc8776'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.532090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a34c1b18ed4909803314c91bdc8776'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.532783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a34c1b18ed4909803314c91bdc8776'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.533580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a34c1b18ed4909803314c91bdc8776'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.542985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-18e84154-b22c-4c40-afd9-9f90f9880f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a34c1b18ed4909803314c91bdc8776'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:33.566355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1038/2101] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:33 2022] DELETE /identity/v3/users/e0a34c1b18ed4909803314c91bdc8776 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:34.164108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.165706 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:34.186290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97befb-3360-4648-847d-c3381c1290c0 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.259594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.260273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.260552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.260852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] PATH_INFO: `/v3/projects/251fce01309c472e9708d2dcde9551fb` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.262049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251fce01309c472e9708d2dcde9551fb)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.263951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.319971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251fce01309c472e9708d2dcde9551fb', 'request_id': 'req-e5677796-36f8-4c8f-9160-5e82f7cdfa63'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:34.328759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251fce01309c472e9708d2dcde9551fb', 'request_id': 'req-e5677796-36f8-4c8f-9160-5e82f7cdfa63'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:34.331895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:34.338264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251fce01309c472e9708d2dcde9551fb', 'request_id': 'req-e5677796-36f8-4c8f-9160-5e82f7cdfa63'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:34.359388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] The token cache is being invalidate because project 251fce01309c472e9708d2dcde9551fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:34.359675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:34.360401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5677796-36f8-4c8f-9160-5e82f7cdfa63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:34.362077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1064/2102] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:34 2022] DELETE /identity/v3/projects/251fce01309c472e9708d2dcde9551fb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:34.370449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.371308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.371397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.393625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:34.395154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:34.470064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1039/2103] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:34.479287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.479592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.479829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.501329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:34.502588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:34.510723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1065/2104] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:34.515475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.527984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d219ee-6941-4157-bf2b-20c636575d00 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.534208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.534901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.535244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.535581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.536297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:34.536600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.540771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.552108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1040/2105] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:34.557279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.568306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152e569-6f54-4f0d-8c08-dc3bbc15e2dc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.575215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.575922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.576510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.576843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.577494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.579390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.609202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1066/2106] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:34 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:34.613696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.625390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cdcb5-efe6-4332-9fc7-8186cc5b22e4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.630027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:34.689563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.690310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.690770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.691056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.691779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.693865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.723558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1041/2107] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:34 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:34.727998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.739266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe1ce9-7969-40e3-8b37-431f717221ce admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.745388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.746361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.746643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.746966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.747619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.749275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.762838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1067/2108] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:34.764082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.775758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab860cd-8644-4703-8770-1b6b85e96839 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.781700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c73563-b0af-483d-b6e1-10907956438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.782307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73563-b0af-483d-b6e1-10907956438a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.782580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73563-b0af-483d-b6e1-10907956438a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.782899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c73563-b0af-483d-b6e1-10907956438a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.783551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73563-b0af-483d-b6e1-10907956438a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.785296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c73563-b0af-483d-b6e1-10907956438a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.797813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1042/2109] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:34.802174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.812585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbcec7-252f-4a5b-91b2-82c294422f5e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:34.817609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:34.818282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.818570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.818902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] PATH_INFO: `/v3/projects/dbe19a61dc574dcc8fc45abe6c63cdaa/users/3493c41d034349df86000b8dcfab74a4/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.837009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe19a61dc574dcc8fc45abe6c63cdaa, user_id=3493c41d034349df86000b8dcfab74a4, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:34.839758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:34.856697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1068/2110] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:34 2022] PUT /identity/v3/projects/dbe19a61dc574dcc8fc45abe6c63cdaa/users/3493c41d034349df86000b8dcfab74a4/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:34.866431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:34.866655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:34.866927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:34.896755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] MFA Rules not processed for user `3493c41d034349df86000b8dcfab74a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:34.897990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:34.965937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1043/2111] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:34.978255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:34.980055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:35.060725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038f06-c0c3-46c4-ab04-6f663266cbdc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:35.064669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a07399-7006-4da5-850c-8564f8103939 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:35.065298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a07399-7006-4da5-850c-8564f8103939 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:35.065574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a07399-7006-4da5-850c-8564f8103939 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:35.065836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a07399-7006-4da5-850c-8564f8103939 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:35.074367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a07399-7006-4da5-850c-8564f8103939 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:35.075780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a07399-7006-4da5-850c-8564f8103939 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:35.084884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1069/2112] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:36.465842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:36.467501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:36.536450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7652d-9448-4f53-88d8-8802007a3777 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:36.541398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:36.542082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:36.542456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:36.542725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] PATH_INFO: `/v3/users/3f349f75766e4e67887eb75879d6bd56` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:36.543863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f349f75766e4e67887eb75879d6bd56)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:36.545830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:36.567301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:36.596961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f349f75766e4e67887eb75879d6bd56'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:36.605493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f349f75766e4e67887eb75879d6bd56'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:36.606175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f349f75766e4e67887eb75879d6bd56'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:36.606801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f349f75766e4e67887eb75879d6bd56'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:36.614874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f349f75766e4e67887eb75879d6bd56'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:36.641407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1044/2113] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:36 2022] DELETE /identity/v3/users/3f349f75766e4e67887eb75879d6bd56 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:36.641531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:36.641531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:36.641531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:36.660378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:36.661707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:36.725468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1070/2114] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:36.735339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:36.736864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:36.796150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04cfc-8525-4647-b086-a3508b567102 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:36.799886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9833c-7e3e-45b2-8f07-8aa8a7d6baa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:36.800497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9833c-7e3e-45b2-8f07-8aa8a7d6baa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:36.800966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9833c-7e3e-45b2-8f07-8aa8a7d6baa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:36.801249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9833c-7e3e-45b2-8f07-8aa8a7d6baa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:36.812111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9833c-7e3e-45b2-8f07-8aa8a7d6baa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:36.813647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9833c-7e3e-45b2-8f07-8aa8a7d6baa1 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:36.823760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1045/2115] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:37.148831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.148831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:37.160667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:37.168133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd7181-b304-4f9d-a706-04c994404543 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.175919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.177516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.177807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.178171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] PATH_INFO: `/v3/projects/ef9c67174a4f4b3cbf0edb1d4638993f` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.179618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef9c67174a4f4b3cbf0edb1d4638993f)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.181840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.261955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef9c67174a4f4b3cbf0edb1d4638993f', 'request_id': 'req-0aabf85b-4680-44c8-85f3-d15ce0d464e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:37.269855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef9c67174a4f4b3cbf0edb1d4638993f', 'request_id': 'req-0aabf85b-4680-44c8-85f3-d15ce0d464e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:37.283175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef9c67174a4f4b3cbf0edb1d4638993f', 'request_id': 'req-0aabf85b-4680-44c8-85f3-d15ce0d464e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:37.294163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] The token cache is being invalidate because project ef9c67174a4f4b3cbf0edb1d4638993f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:37.294440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:37.295080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0aabf85b-4680-44c8-85f3-d15ce0d464e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:37.296576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1071/2116] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:37 2022] DELETE /identity/v3/projects/ef9c67174a4f4b3cbf0edb1d4638993f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:37.302229 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.302566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.302915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.322468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:37.323778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:37.388629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1046/2117] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:37.399883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.400155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.400440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.422623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:37.422821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:37.431499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1072/2118] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:37.436302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.446368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375533d-3f99-4943-9b4e-e1d8937c4f60 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.451237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.451848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.452124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.452393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.453133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:37.453445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.455041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.468128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1047/2119] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:37.472754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.484531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e18a3-888a-4be6-b3b7-424efa06264f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.491040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.491710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.492001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.492298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.493045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.495004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.525834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1073/2120] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:37 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:37.530734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.542060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089861-f7bd-4ae2-a662-5d5221f7b86c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.569409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:37.603469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.604167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.604350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.604696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.605314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.607221 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.637826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1048/2121] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:37 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:37.643727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.655933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a288-6c0c-402d-8c0b-dfc0085f1835 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.664056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.664667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.664919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.665236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.666069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.667783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.679329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1074/2122] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:37.683324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.695803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9c4d-5e36-4b27-859c-bc6b7b70ad28 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.701597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75c81f-b82e-4ed6-97a2-abe3980373b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.702277 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75c81f-b82e-4ed6-97a2-abe3980373b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.702558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75c81f-b82e-4ed6-97a2-abe3980373b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.702825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75c81f-b82e-4ed6-97a2-abe3980373b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.703475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75c81f-b82e-4ed6-97a2-abe3980373b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.705194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75c81f-b82e-4ed6-97a2-abe3980373b3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.719879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1049/2123] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:37.724494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.735234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf5b0a-0e6d-49fc-b41d-3ac8ba1a131d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.740284 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.741039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.741349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.741619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] PATH_INFO: `/v3/projects/0da1a343c3994f5f9f862ade6dde998e/users/a03a54508fdc46ba99f8463594184a99/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.758630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da1a343c3994f5f9f862ade6dde998e, user_id=a03a54508fdc46ba99f8463594184a99, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.761446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.778072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1075/2124] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:37 2022] PUT /identity/v3/projects/0da1a343c3994f5f9f862ade6dde998e/users/a03a54508fdc46ba99f8463594184a99/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:37.788708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.788993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.789284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.818023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] MFA Rules not processed for user `a03a54508fdc46ba99f8463594184a99`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:37.819245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:37.887376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1050/2125] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:37.892192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:37.957413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520ef76-34b8-4629-92e7-7998e8733547 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:37.963467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:37.964166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:37.964446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:37.964741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:37.965384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:37.967416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:37.997983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1076/2126] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:37 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:38.002271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:38.013008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63a75a-c2d5-4132-ab85-5e8142398c35 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:38.070399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:38.071032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.071330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.071580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.072232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:38.074238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:38.097810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1051/2127] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:38 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:38.102086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:38.113257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceab4fd-be84-4788-a43c-ba884ab9382f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:38.118663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:38.119280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.119555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.119819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.120926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:38.122535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:38.125017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:38.136135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1077/2128] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:38.140502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:38.151204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a2fb-8e19-4437-98bc-6123d5a55f27 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:38.156549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:38.157270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.157542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.157889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] PATH_INFO: `/v3/projects/40494faf3de34f638dbfb85f4893c279/users/e73aca030b694e088e066b51a8ece36a/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.175338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40494faf3de34f638dbfb85f4893c279, user_id=e73aca030b694e088e066b51a8ece36a, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:38.178141 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:38.189874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:38.196369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1052/2129] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:38 2022] PUT /identity/v3/projects/40494faf3de34f638dbfb85f4893c279/users/e73aca030b694e088e066b51a8ece36a/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:38.200805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:38.211022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de25fa-f1be-4479-b867-6d81ca6d656a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:38.274495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bded7-9b83-4880-9cb4-c4f5fe711dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:38.275049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bded7-9b83-4880-9cb4-c4f5fe711dba admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.275322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bded7-9b83-4880-9cb4-c4f5fe711dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.275587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bded7-9b83-4880-9cb4-c4f5fe711dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.276223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bded7-9b83-4880-9cb4-c4f5fe711dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:38.277946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bded7-9b83-4880-9cb4-c4f5fe711dba admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:38.289521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1078/2130] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:38.294035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:38.304916 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791e3e9-d49a-471a-a17b-6a98722a52f7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:38.309791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:38.310453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.311021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.311021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] PATH_INFO: `/v3/projects/40494faf3de34f638dbfb85f4893c279/users/e73aca030b694e088e066b51a8ece36a/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.312986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40494faf3de34f638dbfb85f4893c279, user_id=e73aca030b694e088e066b51a8ece36a, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:38.315992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:38.327131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1053/2131] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:38 2022] PUT /identity/v3/projects/40494faf3de34f638dbfb85f4893c279/users/e73aca030b694e088e066b51a8ece36a/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:38.339462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.339785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.340234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.373491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] MFA Rules not processed for user `e73aca030b694e088e066b51a8ece36a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:38.375197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:38.474618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1079/2132] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:38.488390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:38.490933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:38.566840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91b8c9-9b60-419b-845b-086d6675fd1e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:38.572650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874404f1-765d-402b-9182-703710e119e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:38.573921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874404f1-765d-402b-9182-703710e119e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:38.574400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874404f1-765d-402b-9182-703710e119e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:38.575010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874404f1-765d-402b-9182-703710e119e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:38.668686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874404f1-765d-402b-9182-703710e119e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:38.670128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874404f1-765d-402b-9182-703710e119e1 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:38.682421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1054/2133] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:41.286733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:41.353996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3658a-207a-4e51-a040-e6c498bf30f9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:41.359299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:41.359940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:41.360219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:41.360478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] PATH_INFO: `/v3/users/a03a54508fdc46ba99f8463594184a99` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:41.361763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03a54508fdc46ba99f8463594184a99)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:41.363693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:41.388565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:41.415650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03a54508fdc46ba99f8463594184a99'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:41.424176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03a54508fdc46ba99f8463594184a99'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:41.424885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03a54508fdc46ba99f8463594184a99'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:41.425512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03a54508fdc46ba99f8463594184a99'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:41.432469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03a54508fdc46ba99f8463594184a99'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:41.449904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1080/2134] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:41 2022] DELETE /identity/v3/users/a03a54508fdc46ba99f8463594184a99 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:41.454585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:41.455065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:41.455191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:41.474938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:41.476130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:41.546649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1055/2135] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:41.557603 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:41.559165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:41.618741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d999ba7-45b6-4852-8bde-a46788d92840 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:41.623048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:41.623663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:41.623958 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:41.625285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:41.634522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:41.635977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:41.646619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1081/2136] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:41.955677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:41.957198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:41.970363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c51d-8368-4172-861d-9399c326aea8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:41.977599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:41.978611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:41.978772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:41.979385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] PATH_INFO: `/v3/projects/0da1a343c3994f5f9f862ade6dde998e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:41.980650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da1a343c3994f5f9f862ade6dde998e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:41.982685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:42.028077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:42.038575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da1a343c3994f5f9f862ade6dde998e', 'request_id': 'req-282edc10-3c26-4729-bc78-50628a3537a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.046180 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da1a343c3994f5f9f862ade6dde998e', 'request_id': 'req-282edc10-3c26-4729-bc78-50628a3537a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.054463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da1a343c3994f5f9f862ade6dde998e', 'request_id': 'req-282edc10-3c26-4729-bc78-50628a3537a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.065967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] The token cache is being invalidate because project 0da1a343c3994f5f9f862ade6dde998e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:42.066254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.066909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.068482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1056/2137] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:41 2022] DELETE /identity/v3/projects/0da1a343c3994f5f9f862ade6dde998e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:42.072488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:42.083121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90092b6f-c592-4ee3-85ad-be95a7db6ee8 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:42.144452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:42.145135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:42.145413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:42.145687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] PATH_INFO: `/v3/users/e73aca030b694e088e066b51a8ece36a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:42.146936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73aca030b694e088e066b51a8ece36a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:42.148892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:42.198310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:42.201904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73aca030b694e088e066b51a8ece36a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.210888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73aca030b694e088e066b51a8ece36a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.211586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73aca030b694e088e066b51a8ece36a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.212209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73aca030b694e088e066b51a8ece36a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.220798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c5ef51ff-3e3b-4f12-83b6-63f7f50bb342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73aca030b694e088e066b51a8ece36a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.240882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1082/2138] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:42 2022] DELETE /identity/v3/users/e73aca030b694e088e066b51a8ece36a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:42.581823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:42.585045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:42.599816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282edc10-3c26-4729-bc78-50628a3537a1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:42.668344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:42.669026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:42.669303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:42.669618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] PATH_INFO: `/v3/projects/40494faf3de34f638dbfb85f4893c279` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:42.670849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=40494faf3de34f638dbfb85f4893c279)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:42.672826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:42.724145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40494faf3de34f638dbfb85f4893c279', 'request_id': 'req-e8156097-bf06-4eb4-9936-349d02db9a0b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.736774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40494faf3de34f638dbfb85f4893c279', 'request_id': 'req-e8156097-bf06-4eb4-9936-349d02db9a0b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.746287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40494faf3de34f638dbfb85f4893c279', 'request_id': 'req-e8156097-bf06-4eb4-9936-349d02db9a0b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.757857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] The token cache is being invalidate because project 40494faf3de34f638dbfb85f4893c279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:42.758146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.758796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e8156097-bf06-4eb4-9936-349d02db9a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:42.760308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1057/2139] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:42 2022] DELETE /identity/v3/projects/40494faf3de34f638dbfb85f4893c279 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:42.765670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:42.766135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:42.766240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:42.788390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:42.790106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:42.852370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1083/2140] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:42.860248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:42.860559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:42.860880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:42.882134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:42.883362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:42.891563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1058/2141] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:42.896643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:42.906172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed927db0-c983-46f8-8c6c-443c1eb31b19 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:42.910910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:42.911546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:42.911822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:42.912138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:42.912757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:42.913158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:42.915013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:42.933301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1084/2142] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:42.934359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:42.943544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de7c5-d9ae-4a52-9b51-848d0926953b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:42.949752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:42.949752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:42.949752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:42.949752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:42.950157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:42.952000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:42.992442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1059/2143] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:42 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:42.993752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:43.009123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdde859-e47c-4cc8-8cb3-13c266e8f06a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:43.067709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:43.068344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:43.068636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:43.068919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:43.069560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:43.071563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:43.093496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1085/2144] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:42 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:43.097872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:43.109358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cebbe-f4c7-4df2-b77e-f2fbb21c7cbf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:43.114920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:43.115821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:43.115821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:43.116096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:43.116892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:43.118566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:43.130074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1060/2145] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:43.134139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:43.145714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e36634-ece9-463a-9e9a-e993da4e6b4b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:43.150607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363f9ec-5e95-463e-b657-3fdbbbe1a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:43.151217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363f9ec-5e95-463e-b657-3fdbbbe1a3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:43.151548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363f9ec-5e95-463e-b657-3fdbbbe1a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:43.151873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363f9ec-5e95-463e-b657-3fdbbbe1a3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:43.152524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363f9ec-5e95-463e-b657-3fdbbbe1a3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:43.154202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363f9ec-5e95-463e-b657-3fdbbbe1a3f5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:43.165635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1086/2146] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:43.170239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:43.180330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733dfc-be4c-42d6-86ea-18d8f3965037 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:43.186165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:43.186165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:43.186650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:43.186650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] PATH_INFO: `/v3/projects/9ad3de0aef78449ebef0c2c7066f941e/users/789db4babece4dbe93f440bbdc396287/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:43.200664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:43.204831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad3de0aef78449ebef0c2c7066f941e, user_id=789db4babece4dbe93f440bbdc396287, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:43.209885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:43.226438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1061/2147] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:43 2022] PUT /identity/v3/projects/9ad3de0aef78449ebef0c2c7066f941e/users/789db4babece4dbe93f440bbdc396287/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:43.237524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:43.237880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:43.238242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:43.268891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] MFA Rules not processed for user `789db4babece4dbe93f440bbdc396287`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:43.270130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:43.283896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:43.340980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1087/2148] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:43.352159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:43.354159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:43.417761 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a432770-927d-496b-a614-591f7db8ebdf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:43.421448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:43.422113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:43.422385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:43.422649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:43.431572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:43.433091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:43.442022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1062/2149] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:46.386472 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.388055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:46.456516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bd399-d274-462f-ab32-71cfaf1a70a4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.461558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.462194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.462465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.462728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] PATH_INFO: `/v3/users/7922bca503bf423d9796cec2106df14e` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.463852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7922bca503bf423d9796cec2106df14e)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.465870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.516474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7922bca503bf423d9796cec2106df14e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.525588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7922bca503bf423d9796cec2106df14e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.526252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7922bca503bf423d9796cec2106df14e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.526905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7922bca503bf423d9796cec2106df14e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.534581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6500a7b8-0d46-4592-ae56-f1c54d209042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7922bca503bf423d9796cec2106df14e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.556583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1088/2150] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:46 2022] DELETE /identity/v3/users/7922bca503bf423d9796cec2106df14e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:46.563156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.575972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d0b4b-0128-41fc-9989-f55bd95306f0 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.644458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.645231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.645747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.646298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] PATH_INFO: `/v3/users/789db4babece4dbe93f440bbdc396287` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.647774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789db4babece4dbe93f440bbdc396287)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.650474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.700326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789db4babece4dbe93f440bbdc396287'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.708159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789db4babece4dbe93f440bbdc396287'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.708811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789db4babece4dbe93f440bbdc396287'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.709427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789db4babece4dbe93f440bbdc396287'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.716467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789db4babece4dbe93f440bbdc396287'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.737123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1063/2151] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:46 2022] DELETE /identity/v3/users/789db4babece4dbe93f440bbdc396287 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:46.741738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5089-03a6-4603-9418-732200eb97dc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.742021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5089-03a6-4603-9418-732200eb97dc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.742286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5089-03a6-4603-9418-732200eb97dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.745270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.747675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:46.762075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:46.777108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-50af5089-03a6-4603-9418-732200eb97dc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:46.778399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50af5089-03a6-4603-9418-732200eb97dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:46.818987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:46.830231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aa35b-4090-4e45-9358-d1dc37802619 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.836688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:46.837586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:46.838025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:46.838298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] PATH_INFO: `/v3/projects/813693623d8b432c98ac8ad51f22295d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:46.839472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=813693623d8b432c98ac8ad51f22295d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:46.841575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:46.854928 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1089/2152] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:46.877396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5089-03a6-4603-9418-732200eb97dc None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.879331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50af5089-03a6-4603-9418-732200eb97dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:46.921162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813693623d8b432c98ac8ad51f22295d', 'request_id': 'req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.936764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813693623d8b432c98ac8ad51f22295d', 'request_id': 'req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.949323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813693623d8b432c98ac8ad51f22295d', 'request_id': 'req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.971188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] The token cache is being invalidate because project 813693623d8b432c98ac8ad51f22295d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:46.972220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.973052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:46.979486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1064/2153] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:46 2022] DELETE /identity/v3/projects/813693623d8b432c98ac8ad51f22295d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:46.979710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5089-03a6-4603-9418-732200eb97dc None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:46.980441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:46.982104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.044517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.045165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.045445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.045719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.047697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.048023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b1d5f-f459-4544-b6ef-0fcbcb4f00ed admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.052749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.053378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.053660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.053927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] PATH_INFO: `/v3/users/9c4b50cd24bc4f7897456cb39f3591c1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.055040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4b50cd24bc4f7897456cb39f3591c1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.057059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.059607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.061078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.071613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1090/2154] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:47.106276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:47.108526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4b50cd24bc4f7897456cb39f3591c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.117485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4b50cd24bc4f7897456cb39f3591c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.118209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4b50cd24bc4f7897456cb39f3591c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.118997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4b50cd24bc4f7897456cb39f3591c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.128530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4b50cd24bc4f7897456cb39f3591c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.148771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1065/2155] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:46 2022] DELETE /identity/v3/users/9c4b50cd24bc4f7897456cb39f3591c1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:47.345898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.357123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.358783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.375733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a41fc-f3da-41fe-b536-cb130e7f7247 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.433048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef257906-68ff-4fbf-ab8e-0f806745d41e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.440729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.440729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.440729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.440729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] PATH_INFO: `/v3/projects/9ad3de0aef78449ebef0c2c7066f941e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.441150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad3de0aef78449ebef0c2c7066f941e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.442437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.449672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.450352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.450630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.450901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] PATH_INFO: `/v3/projects/39921738f8cf4304b2b27a54df35ddc5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.452020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39921738f8cf4304b2b27a54df35ddc5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.454180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.494857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad3de0aef78449ebef0c2c7066f941e', 'request_id': 'req-bdcee35c-18bf-4d7e-b25a-406da16039d8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.499404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:47.501985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad3de0aef78449ebef0c2c7066f941e', 'request_id': 'req-bdcee35c-18bf-4d7e-b25a-406da16039d8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.510482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39921738f8cf4304b2b27a54df35ddc5', 'request_id': 'req-a5d54787-8762-48a1-baea-cd4f01952b45'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.510907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad3de0aef78449ebef0c2c7066f941e', 'request_id': 'req-bdcee35c-18bf-4d7e-b25a-406da16039d8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.517468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39921738f8cf4304b2b27a54df35ddc5', 'request_id': 'req-a5d54787-8762-48a1-baea-cd4f01952b45'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.522347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] The token cache is being invalidate because project 9ad3de0aef78449ebef0c2c7066f941e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:47.522711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.523458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bdcee35c-18bf-4d7e-b25a-406da16039d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.526304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1066/2156] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:47 2022] DELETE /identity/v3/projects/9ad3de0aef78449ebef0c2c7066f941e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:47.526575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39921738f8cf4304b2b27a54df35ddc5', 'request_id': 'req-a5d54787-8762-48a1-baea-cd4f01952b45'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.531556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1e5fd-83c3-4c1c-9066-c0c072a89891 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.531860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1e5fd-83c3-4c1c-9066-c0c072a89891 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.532817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1e5fd-83c3-4c1c-9066-c0c072a89891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.540877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] The token cache is being invalidate because project 39921738f8cf4304b2b27a54df35ddc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:47.541169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.541856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a5d54787-8762-48a1-baea-cd4f01952b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:47.543505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1091/2157] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:47 2022] DELETE /identity/v3/projects/39921738f8cf4304b2b27a54df35ddc5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:47.549865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd6ae-8341-4341-80cb-e5585dd488a7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.550150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd6ae-8341-4341-80cb-e5585dd488a7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.550424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd6ae-8341-4341-80cb-e5585dd488a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.554809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0ec1e5fd-83c3-4c1c-9066-c0c072a89891 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:47.556563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0ec1e5fd-83c3-4c1c-9066-c0c072a89891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.572248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f87fd6ae-8341-4341-80cb-e5585dd488a7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:47.573609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f87fd6ae-8341-4341-80cb-e5585dd488a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.612663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:47.629645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1067/2158] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:47.638518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.638666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1092/2159] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:47.638852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.639052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.646249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.646532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.646807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.660096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:47.661338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.666295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:47.667466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:47.669704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1068/2160] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:47.673824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.676031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1093/2161] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:47.680133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.685074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52da7a-ed6a-4635-b61a-2b611baca3bc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.689548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557844d-bb15-46d8-a358-a7293350b26f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.690949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.691631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.692707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.692707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.692920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:47.693586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.694229 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.694741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.694844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.695089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.695358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.696003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:47.696300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.697999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.709191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1069/2162] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:47.715088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1094/2163] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:59:47.715320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.716181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.724433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f51ab-bde3-49b4-9166-6f6e3129ba46 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.726446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b695b9a-df38-4617-8704-c2f495467e42 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.730023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.730580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.730857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.731126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.731458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.731758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.732056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.732329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.732640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.733261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.733735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.735233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.764762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1095/2164] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:47.768242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.768638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1070/2165] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:47.772562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.835881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a556ce-8aad-4dc8-b4f3-cf48f3a8579a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.836138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7db3ba-8be1-497d-94ba-0b1d4fc81d27 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.841502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.841848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.842275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.842459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.842692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.842910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.843153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.843260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.843947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.844331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.846023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.847289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.871672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1096/2166] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:47.875211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1071/2167] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:47 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:47.879214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.879351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.889656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767a89b-57aa-41d9-9b1c-8a3a6106505c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.889829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acef92-0880-4f6e-b5a5-9c423015b3fb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.895042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.895319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.895615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.895922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.896096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.896209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.896298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.896440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.896864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.897113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.898615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.898729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.912512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1097/2168] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:47.912759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1072/2169] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:47.913596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.914829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.919069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:47.925194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b1da-826c-45b1-8b1b-38cb3c7ac68b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.927113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd645-3304-42e2-a559-ce4c79999d51 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.929920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.930527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.930806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.931076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.931714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.933357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.933486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.934044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.934327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.934597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.935344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.937093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.945835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1073/2170] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:47.951094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.953591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1098/2171] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:47.958151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:47.964977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b775e59-95de-4fd7-8bca-7d88d432d64e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.970244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c6c5a-f93c-46bc-b179-b1087b8a12e4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:47.971876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07c640-afed-4b2c-aca8-1bb4cd41b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.972638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c640-afed-4b2c-aca8-1bb4cd41b0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.972897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c640-afed-4b2c-aca8-1bb4cd41b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.973167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07c640-afed-4b2c-aca8-1bb4cd41b0b7 admin admin] PATH_INFO: `/v3/projects/745e314adce34df48c074986e4dfd110/users/6e6b2e62369448428e38fb0bc715f302/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.975081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d6247-7d1c-4d41-a598-cd9a09ea7f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:47.975751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6247-7d1c-4d41-a598-cd9a09ea7f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:47.976052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6247-7d1c-4d41-a598-cd9a09ea7f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:47.977200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6247-7d1c-4d41-a598-cd9a09ea7f51 admin admin] PATH_INFO: `/v3/projects/c6b20ed3bb7a47cd9069502bec441fac/users/177dd968f1f04dde8e8e679d21f33b5d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:47.988382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07c640-afed-4b2c-aca8-1bb4cd41b0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745e314adce34df48c074986e4dfd110, user_id=6e6b2e62369448428e38fb0bc715f302, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.991217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07c640-afed-4b2c-aca8-1bb4cd41b0b7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:47.991348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d6247-7d1c-4d41-a598-cd9a09ea7f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b20ed3bb7a47cd9069502bec441fac, user_id=177dd968f1f04dde8e8e679d21f33b5d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:47.994080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d6247-7d1c-4d41-a598-cd9a09ea7f51 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.006723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1074/2172] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:47 2022] PUT /identity/v3/projects/745e314adce34df48c074986e4dfd110/users/6e6b2e62369448428e38fb0bc715f302/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:48.015606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1099/2173] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:47 2022] PUT /identity/v3/projects/c6b20ed3bb7a47cd9069502bec441fac/users/177dd968f1f04dde8e8e679d21f33b5d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:48.017241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.017713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.018025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.021800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.022085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.023566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.051063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] MFA Rules not processed for user `177dd968f1f04dde8e8e679d21f33b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:48.052264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] MFA Rules not processed for user `6e6b2e62369448428e38fb0bc715f302`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:48.052383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:48.053478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:48.107272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.130684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1075/2174] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:48.135198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.136949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1100/2175] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:48.142148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.202900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcddfec-f1ed-400e-b503-10f1ebdbc413 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.207738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.208374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.208700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.208970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.209605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.211500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.221788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96eb10-f94d-481a-a21f-79c8d160e9a5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.226335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.226948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.227255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.227488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.228163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.230130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.240600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1076/2176] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:48.244668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.267935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1101/2177] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:48.269080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.320394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91615324-1fe8-4f1e-a230-fac96198ff54 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.322738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.344983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499b3f-7eab-492e-86e0-6aad89b862ce admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.349822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.350457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.350754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.351025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.351646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.353610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.376709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1102/2178] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:48.379901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.380528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.380654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.380889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.381109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.381779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.385115 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.391663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a467f-a495-455d-9388-935ea87d0478 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.398388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.399042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.399320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.399606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.400321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.401931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.410148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1077/2179] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:48.414442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.418300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1103/2180] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:48.419361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.425574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a91688-94b5-4e6a-9519-adf5eeb6d8c5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.430412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.431036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.431322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.431577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.432226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c4205-9358-44fa-922a-c0b9668faf4f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.432341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.434102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.435431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.437571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.438220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.438608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.438785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.439432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.441071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.448599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1078/2181] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:48.452641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.457353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1104/2182] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:48.458365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.464288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caa7cf-cd3b-42bf-9617-a4b48467b0f5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.468441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482edff8-70d4-4c21-97ec-7fab286660d2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.469201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.469903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.470280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.470553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.471199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.472877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.473404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0b21-580f-4c1a-940a-8ceb7738cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.474050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0b21-580f-4c1a-940a-8ceb7738cf95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.474376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0b21-580f-4c1a-940a-8ceb7738cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.474653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0b21-580f-4c1a-940a-8ceb7738cf95 admin admin] PATH_INFO: `/v3/projects/c825d9c2dc7746e08f2e545d260a0b56/users/d59687abdbcc4108a8fbaa03592e0855/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.484247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1079/2183] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:48.488363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.489976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0b21-580f-4c1a-940a-8ceb7738cf95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c825d9c2dc7746e08f2e545d260a0b56, user_id=d59687abdbcc4108a8fbaa03592e0855, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.492732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0b21-580f-4c1a-940a-8ceb7738cf95 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.499497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b48b3-761e-4ccd-adbf-84e598176b30 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.505085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c8c74-3cb1-4e16-bd5f-f603335be8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.505793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8c74-3cb1-4e16-bd5f-f603335be8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.506074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8c74-3cb1-4e16-bd5f-f603335be8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.506409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8c74-3cb1-4e16-bd5f-f603335be8b2 admin admin] PATH_INFO: `/v3/projects/cbab923150024e28bf6f51f92e956c47/users/8e5abc856cee4fd4a47b33685fade8af/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.509593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1105/2184] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:48 2022] PUT /identity/v3/projects/c825d9c2dc7746e08f2e545d260a0b56/users/d59687abdbcc4108a8fbaa03592e0855/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:48.520815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.521100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.521373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.535665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c8c74-3cb1-4e16-bd5f-f603335be8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbab923150024e28bf6f51f92e956c47, user_id=8e5abc856cee4fd4a47b33685fade8af, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.538501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c8c74-3cb1-4e16-bd5f-f603335be8b2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.552243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] MFA Rules not processed for user `d59687abdbcc4108a8fbaa03592e0855`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:48.553494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:48.555972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1080/2185] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:48 2022] PUT /identity/v3/projects/cbab923150024e28bf6f51f92e956c47/users/8e5abc856cee4fd4a47b33685fade8af/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:48.567580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.568121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.568457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.598639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] MFA Rules not processed for user `8e5abc856cee4fd4a47b33685fade8af`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:48.600084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:48.619844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1106/2186] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:48.624695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.668883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1081/2187] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:48.674564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.690121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8a71-bcec-40f5-bd11-616ccf35758e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.694778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.695391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.695670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.695942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.696624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.698549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.719942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.727342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1107/2188] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:48.731068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.734344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e364c-6524-40dd-bff1-b29eec97373c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.786864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:48.794640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.795258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.795531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.795794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.796724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.799157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.805142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5865b8-7a7b-4cf8-accb-cfa7ce83500a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.810144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.810759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.811037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.811310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.811975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.813916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.828538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1082/2189] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:48.832776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.835141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1108/2190] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:48.838923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.848539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0147-9e85-47a9-a147-3f7c8be36ead admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.895580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b5d6-e3b5-4ac2-826c-4f8d4be51848 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.900701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.901275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.901582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.901811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.902451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.904381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.905961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.906581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.906853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.907119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.907760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.909407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.920561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1109/2191] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:48.925024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.930271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1083/2192] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:48 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:48.931412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.936089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f6222-2160-42a9-9e03-5321219b2885 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.940877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.941538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.941932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.942205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] PATH_INFO: `/v3/projects/195f5d344a51456faf21321c7dffaf6d/users/660f8febed8f426f9cf5659157ff68a2/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.942399 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acae1-500d-4186-8ee5-a6c4a3fd4308 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.947062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:48.947672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:48.947942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:48.948206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:48.948870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.950457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.958325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=195f5d344a51456faf21321c7dffaf6d, user_id=660f8febed8f426f9cf5659157ff68a2, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:48.961272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:48.964796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1084/2193] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:48.965856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:48.975778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009f83-9277-4690-8009-d70d2302acbd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:48.976028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1110/2194] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:48 2022] PUT /identity/v3/projects/195f5d344a51456faf21321c7dffaf6d/users/660f8febed8f426f9cf5659157ff68a2/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:48.979938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.039274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.039947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.040227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.040500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] PATH_INFO: `/v3/projects/212aa1e99efb4c22babf4939c830711e/users/d031f3197f434cb0a47fbcc9c35c96b5/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.042469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d813cc7-774d-4325-94ad-10f36edd2dd6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.047137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.047741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.048015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.048280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.048968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.050552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.052972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.056051 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=212aa1e99efb4c22babf4939c830711e, user_id=d031f3197f434cb0a47fbcc9c35c96b5, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.059093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.064326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1111/2195] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:49.065221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.074909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1085/2196] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:48 2022] PUT /identity/v3/projects/212aa1e99efb4c22babf4939c830711e/users/d031f3197f434cb0a47fbcc9c35c96b5/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:49.075103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5b12-12b3-4e0d-af85-5e6d6f56e605 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.079153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.124982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.134750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb7c6a-0d26-4af8-abc4-72eddda4484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.135493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7c6a-0d26-4af8-abc4-72eddda4484b admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.135794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7c6a-0d26-4af8-abc4-72eddda4484b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.136112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb7c6a-0d26-4af8-abc4-72eddda4484b admin admin] PATH_INFO: `/v3/projects/195f5d344a51456faf21321c7dffaf6d/users/660f8febed8f426f9cf5659157ff68a2/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.138204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb7c6a-0d26-4af8-abc4-72eddda4484b admin admin] RBAC: Authorizing `identity:create_grant(project_id=195f5d344a51456faf21321c7dffaf6d, user_id=660f8febed8f426f9cf5659157ff68a2, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.141141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb7c6a-0d26-4af8-abc4-72eddda4484b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.142048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160629f0-c8c8-448f-8774-13893ff7e65d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.146995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.147928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.148211 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.148479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.149161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.150755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.151780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1112/2197] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:49 2022] PUT /identity/v3/projects/195f5d344a51456faf21321c7dffaf6d/users/660f8febed8f426f9cf5659157ff68a2/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:49.161062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1086/2198] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:59:49.163630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.163630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.163630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.165128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.175179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646344bd-3f75-44a4-aa00-490cd06951c7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.195695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] MFA Rules not processed for user `660f8febed8f426f9cf5659157ff68a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:49.196976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:49.243671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942874d4-44b0-4733-aa74-618a159f5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.244346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942874d4-44b0-4733-aa74-618a159f5d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.244631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942874d4-44b0-4733-aa74-618a159f5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.244942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942874d4-44b0-4733-aa74-618a159f5d1a admin admin] PATH_INFO: `/v3/projects/212aa1e99efb4c22babf4939c830711e/users/d031f3197f434cb0a47fbcc9c35c96b5/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.247208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942874d4-44b0-4733-aa74-618a159f5d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=212aa1e99efb4c22babf4939c830711e, user_id=d031f3197f434cb0a47fbcc9c35c96b5, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.250131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942874d4-44b0-4733-aa74-618a159f5d1a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.263025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1087/2199] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:49 2022] PUT /identity/v3/projects/212aa1e99efb4c22babf4939c830711e/users/d031f3197f434cb0a47fbcc9c35c96b5/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:49.273200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.273499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.273743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.286937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1113/2200] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:59:49.299835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.302574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:49.311801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] MFA Rules not processed for user `d031f3197f434cb0a47fbcc9c35c96b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:49.313021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:49.374963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c06d80-5347-42d6-8ae6-266024d725de None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.411870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1088/2201] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:49.422989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.425562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:49.427347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:49.445961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.446444 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.446718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.446982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.489167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af57c0-c558-4d0f-995d-ba76d92d1dc1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:49.492888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:49.493541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:49.493820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:49.494087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:49.505892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.507418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.508240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.517554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1114/2202] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:59:49.553971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:49.555443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:49.564251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1089/2203] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:51.104689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.115136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac21e3-3649-4ffd-a876-6bca7dc79d1a service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.119424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.120094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.120522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.121366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.199294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.201946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.205074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:51.214186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897953e-d50a-49a4-ad28-f67d481661b8 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:51.216765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1115/2204] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:51.218764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:51.219481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:51.219853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:51.220134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:51.304429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:51.305933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:51.318260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1090/2205] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:59:51.993163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:52.003189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17cc2a-86dd-4c97-8439-655c7ce4703e service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:52.007301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811237de-16ba-4cca-a2d0-cf10c80be356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:52.007911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811237de-16ba-4cca-a2d0-cf10c80be356 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:52.008189 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811237de-16ba-4cca-a2d0-cf10c80be356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:52.008457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811237de-16ba-4cca-a2d0-cf10c80be356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:52.027527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:52.036266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f3e-1f1e-486d-a9e4-499d4c79e443 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:52.040191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:52.040856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:52.041528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:52.041528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:52.050879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:52.052433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:52.062603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1091/2206] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:52.073092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811237de-16ba-4cca-a2d0-cf10c80be356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:52.074836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811237de-16ba-4cca-a2d0-cf10c80be356 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:52.084891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1116/2207] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:56.273505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.339587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbbcaa-5e41-41d9-b335-8461aaec4253 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.345154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.345788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.346109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.346376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] PATH_INFO: `/v3/users/6e6b2e62369448428e38fb0bc715f302` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.347604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e6b2e62369448428e38fb0bc715f302)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.349655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.394977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:56.400953 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e6b2e62369448428e38fb0bc715f302'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.409913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e6b2e62369448428e38fb0bc715f302'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.410530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e6b2e62369448428e38fb0bc715f302'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.411132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e6b2e62369448428e38fb0bc715f302'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.418016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e6b2e62369448428e38fb0bc715f302'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.435246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1092/2208] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:56 2022] DELETE /identity/v3/users/6e6b2e62369448428e38fb0bc715f302 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:56.439775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.440266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.440355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.460527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:56.461756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.475880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:56.532983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1117/2209] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:56.542632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.544248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.587555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.589030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.601564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c227d-ffba-4f9b-99ee-52f940358b69 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.606514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.607140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.607428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.608007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] PATH_INFO: `/v3/users/177dd968f1f04dde8e8e679d21f33b5d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.609066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=177dd968f1f04dde8e8e679d21f33b5d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.611663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.623086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f012-782e-4ff0-9e0d-66f2d7b3f75e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.627891 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708cd0-9bd3-4986-9e03-fcf4985b8c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.628583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708cd0-9bd3-4986-9e03-fcf4985b8c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.629053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708cd0-9bd3-4986-9e03-fcf4985b8c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.629396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708cd0-9bd3-4986-9e03-fcf4985b8c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.638709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708cd0-9bd3-4986-9e03-fcf4985b8c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.640331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708cd0-9bd3-4986-9e03-fcf4985b8c5c service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.652245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1093/2210] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:56.668087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '177dd968f1f04dde8e8e679d21f33b5d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.675761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '177dd968f1f04dde8e8e679d21f33b5d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.676681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '177dd968f1f04dde8e8e679d21f33b5d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.677362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '177dd968f1f04dde8e8e679d21f33b5d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.684807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '177dd968f1f04dde8e8e679d21f33b5d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:56.704395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1118/2211] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:56 2022] DELETE /identity/v3/users/177dd968f1f04dde8e8e679d21f33b5d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:56.709171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.709465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.709762 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.729995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:56.731205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.799604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1094/2212] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:56.811590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:56.813270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:56.902859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2dcb1-e315-41b9-9557-59207e65c755 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:56.907325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:56.908041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:56.908826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:56.908979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:56.919282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:56.921291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:56.934276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1119/2213] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:57.024055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:57.025684 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:57.038041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e99621-bfd7-40d3-8093-9e22f9073175 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:57.044065 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:57.044754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.045040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.045430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] PATH_INFO: `/v3/projects/745e314adce34df48c074986e4dfd110` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.047114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] RBAC: Authorizing `identity:delete_project(project_id=745e314adce34df48c074986e4dfd110)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:57.059650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:57.123266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745e314adce34df48c074986e4dfd110', 'request_id': 'req-5ecc0224-a09b-4daa-9bf9-34c8e407597d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.132178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745e314adce34df48c074986e4dfd110', 'request_id': 'req-5ecc0224-a09b-4daa-9bf9-34c8e407597d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.137909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:57.144164 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745e314adce34df48c074986e4dfd110', 'request_id': 'req-5ecc0224-a09b-4daa-9bf9-34c8e407597d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.166078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] The token cache is being invalidate because project 745e314adce34df48c074986e4dfd110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:57.166078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.166730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.171577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1095/2214] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:57 2022] DELETE /identity/v3/projects/745e314adce34df48c074986e4dfd110 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:57.172779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:57.184481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffb3de-ff7e-4b31-9369-6a3aa50eb1fd service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:57.228035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:57.280848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:57.280848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.280848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.280848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] PATH_INFO: `/v3/users/8e5abc856cee4fd4a47b33685fade8af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.281231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5abc856cee4fd4a47b33685fade8af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:57.281231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:57.304379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:57.307757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:57.324745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc0224-a09b-4daa-9bf9-34c8e407597d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:57.333216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:57.334631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.334973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.335285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] PATH_INFO: `/v3/projects/c6b20ed3bb7a47cd9069502bec441fac` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.336814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b20ed3bb7a47cd9069502bec441fac)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:57.339082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:57.346798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5abc856cee4fd4a47b33685fade8af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.362959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5abc856cee4fd4a47b33685fade8af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.363813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5abc856cee4fd4a47b33685fade8af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.364575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5abc856cee4fd4a47b33685fade8af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.390590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5abc856cee4fd4a47b33685fade8af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.416576 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b20ed3bb7a47cd9069502bec441fac', 'request_id': 'req-e937747b-b2e4-4fc9-83d7-43c41a8792bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.426687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b20ed3bb7a47cd9069502bec441fac', 'request_id': 'req-e937747b-b2e4-4fc9-83d7-43c41a8792bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.436308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1120/2215] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:57 2022] DELETE /identity/v3/users/8e5abc856cee4fd4a47b33685fade8af => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:57.438249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b20ed3bb7a47cd9069502bec441fac', 'request_id': 'req-e937747b-b2e4-4fc9-83d7-43c41a8792bd'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.449998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] The token cache is being invalidate because project c6b20ed3bb7a47cd9069502bec441fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:57.450917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.451324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.456071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1096/2216] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:57 2022] DELETE /identity/v3/projects/c6b20ed3bb7a47cd9069502bec441fac => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:57.457665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:57.459122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:57.548332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3387e78-29b1-441a-add8-234ee94fa167 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:57.554642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:57.555427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:57.555819 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:57.556094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] PATH_INFO: `/v3/users/d59687abdbcc4108a8fbaa03592e0855` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:57.557312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59687abdbcc4108a8fbaa03592e0855)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:57.559579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:57.624976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59687abdbcc4108a8fbaa03592e0855'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.636312 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59687abdbcc4108a8fbaa03592e0855'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.638045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59687abdbcc4108a8fbaa03592e0855'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.638842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59687abdbcc4108a8fbaa03592e0855'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.641816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:57.651533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59687abdbcc4108a8fbaa03592e0855'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:57.677744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1121/2217] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:57 2022] DELETE /identity/v3/users/d59687abdbcc4108a8fbaa03592e0855 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:57.822342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:57.824278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:57.927804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937747b-b2e4-4fc9-83d7-43c41a8792bd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.031700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.032488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.032884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.033475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] PATH_INFO: `/v3/projects/cbab923150024e28bf6f51f92e956c47` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.035094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbab923150024e28bf6f51f92e956c47)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.037168 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.064365 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:58.113616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbab923150024e28bf6f51f92e956c47', 'request_id': 'req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.123396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbab923150024e28bf6f51f92e956c47', 'request_id': 'req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.135775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbab923150024e28bf6f51f92e956c47', 'request_id': 'req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.160077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] The token cache is being invalidate because project cbab923150024e28bf6f51f92e956c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:58.160424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.161190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.162830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1097/2218] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:57 2022] DELETE /identity/v3/projects/cbab923150024e28bf6f51f92e956c47 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:58.167350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.168955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.185676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b665a7-dca0-4325-b419-24a7ac7534c7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.190510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.192812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.262944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.263697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.264040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.264376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] PATH_INFO: `/v3/users/d031f3197f434cb0a47fbcc9c35c96b5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.265571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6e4a7-4f30-4de6-b04d-ac614e83a5db admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.265684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d031f3197f434cb0a47fbcc9c35c96b5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.267676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.270215 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.270848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.271129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.271398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] PATH_INFO: `/v3/projects/c825d9c2dc7746e08f2e545d260a0b56` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.272636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c825d9c2dc7746e08f2e545d260a0b56)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.274456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.325282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd031f3197f434cb0a47fbcc9c35c96b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.334165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd031f3197f434cb0a47fbcc9c35c96b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.334816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd031f3197f434cb0a47fbcc9c35c96b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.335413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd031f3197f434cb0a47fbcc9c35c96b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.336756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c825d9c2dc7746e08f2e545d260a0b56', 'request_id': 'req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.342785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd031f3197f434cb0a47fbcc9c35c96b5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.343577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c825d9c2dc7746e08f2e545d260a0b56', 'request_id': 'req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.352227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c825d9c2dc7746e08f2e545d260a0b56', 'request_id': 'req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.360313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1122/2219] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:58 2022] DELETE /identity/v3/users/d031f3197f434cb0a47fbcc9c35c96b5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:58.363534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] The token cache is being invalidate because project c825d9c2dc7746e08f2e545d260a0b56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:58.363937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.364692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.366294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1098/2220] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:58 2022] DELETE /identity/v3/projects/c825d9c2dc7746e08f2e545d260a0b56 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:58.370022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.371896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.429468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:58.442992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198978a7-75d7-4853-b6f3-ef26c8a47bad admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.448179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.448872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.449131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.449398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] PATH_INFO: `/v3/users/660f8febed8f426f9cf5659157ff68a2` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.450552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=660f8febed8f426f9cf5659157ff68a2)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.452508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.500701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660f8febed8f426f9cf5659157ff68a2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.509103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660f8febed8f426f9cf5659157ff68a2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.509725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660f8febed8f426f9cf5659157ff68a2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.510342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660f8febed8f426f9cf5659157ff68a2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.517341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660f8febed8f426f9cf5659157ff68a2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.539804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1123/2221] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 19:59:58 2022] DELETE /identity/v3/users/660f8febed8f426f9cf5659157ff68a2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:58.750808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.752832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.811257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:58.837400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc0644-3fe2-4bee-be6f-0ea3e258c107 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.890391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:58.891973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:58.901036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:58.901617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:58.901907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:58.902195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] PATH_INFO: `/v3/projects/212aa1e99efb4c22babf4939c830711e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:58.903347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=212aa1e99efb4c22babf4939c830711e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:58.905303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:58.962669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '212aa1e99efb4c22babf4939c830711e', 'request_id': 'req-527eac20-0fd5-4160-9e6c-aa38f3133f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.969403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '212aa1e99efb4c22babf4939c830711e', 'request_id': 'req-527eac20-0fd5-4160-9e6c-aa38f3133f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.979309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '212aa1e99efb4c22babf4939c830711e', 'request_id': 'req-527eac20-0fd5-4160-9e6c-aa38f3133f90'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.979522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4e7a8-ca79-4194-bd47-8f2ce5580b9f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:58.991692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] The token cache is being invalidate because project 212aa1e99efb4c22babf4939c830711e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:58.991982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.992652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-527eac20-0fd5-4160-9e6c-aa38f3133f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:58.994566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1099/2222] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:58 2022] DELETE /identity/v3/projects/212aa1e99efb4c22babf4939c830711e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:59.052925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.053688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.054076 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.054421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] PATH_INFO: `/v3/projects/195f5d344a51456faf21321c7dffaf6d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.056251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195f5d344a51456faf21321c7dffaf6d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.058510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.088372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:59.136300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195f5d344a51456faf21321c7dffaf6d', 'request_id': 'req-0de22244-7707-40a7-bb53-caf9daed0857'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:59.143890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195f5d344a51456faf21321c7dffaf6d', 'request_id': 'req-0de22244-7707-40a7-bb53-caf9daed0857'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:59.155635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195f5d344a51456faf21321c7dffaf6d', 'request_id': 'req-0de22244-7707-40a7-bb53-caf9daed0857'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:59.169024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] The token cache is being invalidate because project 195f5d344a51456faf21321c7dffaf6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:59:59.169410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:59.170010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0de22244-7707-40a7-bb53-caf9daed0857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:59:59.171829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1124/2223] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 19:59:58 2022] DELETE /identity/v3/projects/195f5d344a51456faf21321c7dffaf6d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:59:59.177064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.177393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.177624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.210764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:59.212319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:59.281751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1100/2224] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:59.292967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.293331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.293814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.315723 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:59.317294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:59.326938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1125/2225] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:59.331339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.341567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da493b6-ebf9-4437-b145-79f447b9523d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.348106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.348893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.349272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.349636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.350396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:59:59.350798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.352600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.364260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:59.372642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1101/2226] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 19:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:59.373231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.385579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1ba1-5e1a-49d6-aa4e-34ea5f6023f0 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.391457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.392136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.392338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.392604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.393325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.396166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.430936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1126/2227] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 19:59:59 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:59:59.435007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.448222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5598bf-7734-4ab9-8786-98fc9c6ef7dc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.520134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.520880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.521154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.521326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.522010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.523975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.545570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1102/2228] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 19:59:59 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:59:59.550070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.560422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be62a4-0fbf-4205-b5ec-b00c63482bf4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.565195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.565798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.566077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.566348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.566991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.568571 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.578536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1127/2229] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:59.582625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.592853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c9ae3-a522-4f16-af05-b1fddd86b4fc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.598378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194152e-01c4-4d97-b3d9-a187fdf00207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.598972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194152e-01c4-4d97-b3d9-a187fdf00207 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.599247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194152e-01c4-4d97-b3d9-a187fdf00207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.599512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194152e-01c4-4d97-b3d9-a187fdf00207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.600179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194152e-01c4-4d97-b3d9-a187fdf00207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.601817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194152e-01c4-4d97-b3d9-a187fdf00207 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.612741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1103/2230] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 19:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:59:59.617202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.627476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188444-de48-4b6c-adf9-ee1890b03875 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.632297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.632973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.633253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.633551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] PATH_INFO: `/v3/projects/d1e4432b477444c583a1c6067fd56949/users/2c4ed6152a3b4e8c99e9896b531ecb4f/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.648307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e4432b477444c583a1c6067fd56949, user_id=2c4ed6152a3b4e8c99e9896b531ecb4f, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.650988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.667649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1128/2231] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 19:59:59 2022] PUT /identity/v3/projects/d1e4432b477444c583a1c6067fd56949/users/2c4ed6152a3b4e8c99e9896b531ecb4f/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:59:59.673105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583e8e-61d4-4b51-9c8d-3937f3da0f09 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.673383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583e8e-61d4-4b51-9c8d-3937f3da0f09 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.673651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7583e8e-61d4-4b51-9c8d-3937f3da0f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.693919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e7583e8e-61d4-4b51-9c8d-3937f3da0f09 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:59.695153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e7583e8e-61d4-4b51-9c8d-3937f3da0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:59.757959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1104/2232] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:59.768496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.770303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:59.833474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7face9-9a1a-495e-b8dc-9e3ac753a5c5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.837069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.837674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.837947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.838226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.847844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.849338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.859985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1129/2233] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:00.852003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66ebce-bbc4-4b8b-aa3a-34d109eb9474 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:00.852467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66ebce-bbc4-4b8b-aa3a-34d109eb9474 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:00.852588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66ebce-bbc4-4b8b-aa3a-34d109eb9474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:00.881840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7d66ebce-bbc4-4b8b-aa3a-34d109eb9474 None None] MFA Rules not processed for user `2c4ed6152a3b4e8c99e9896b531ecb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:00.883084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7d66ebce-bbc4-4b8b-aa3a-34d109eb9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:00.954760 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1105/2234] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:00.967204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:00.968649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:01.023254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:01.027451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28c0f-4b7e-46d3-a04d-474e51e51cc1 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:01.032682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:01.033678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:01.034228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:01.034510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:01.043319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:01.044785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:01.054125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1130/2235] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:02.433568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:02.434093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:02.434186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:02.454690 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] MFA Rules not processed for user `2c4ed6152a3b4e8c99e9896b531ecb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:02.455915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:02.464172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1106/2236] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:03.541143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:03.541143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:03.560498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd1045-872b-4059-868e-b3ea9099eb51 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:03.565572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:03.566365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:03.566840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:03.567109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:03.568919 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:03.650205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:03.651585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48873bd9-8bc6-43fa-a5f7-d963ef822914 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:03.661375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1131/2237] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:09.280459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:09.282152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:09.293294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:09.302069 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904a7c-3e2d-49b8-96e1-1ee97c85b35b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:09.307581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:09.308304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:09.308709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:09.309046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] PATH_INFO: `/v3/users/3493c41d034349df86000b8dcfab74a4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:09.310297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3493c41d034349df86000b8dcfab74a4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:09.312307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:09.371617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3493c41d034349df86000b8dcfab74a4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:09.382289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3493c41d034349df86000b8dcfab74a4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:09.382982 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3493c41d034349df86000b8dcfab74a4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:09.383652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3493c41d034349df86000b8dcfab74a4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:09.391736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3493c41d034349df86000b8dcfab74a4'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:09.416084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1107/2238] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:00:09 2022] DELETE /identity/v3/users/3493c41d034349df86000b8dcfab74a4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:09.420967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:09.421823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:09.422093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:09.461613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:09.462844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:09.532210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1132/2239] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:09.542478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:09.544018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:09.607026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad405-218b-4b52-abe5-7a563c1df9ab admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:09.611393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9526c-d373-4f11-b880-0c6be6ed68f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:09.612049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9526c-d373-4f11-b880-0c6be6ed68f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:09.612321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9526c-d373-4f11-b880-0c6be6ed68f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:09.612627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9526c-d373-4f11-b880-0c6be6ed68f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:09.623859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9526c-d373-4f11-b880-0c6be6ed68f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:09.625296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9526c-d373-4f11-b880-0c6be6ed68f0 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:09.636535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1108/2240] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:09.940966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:09.943253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:09.955507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cb458-0954-473d-b346-be3d3733e164 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:09.960191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:09.960867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:09.961145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:09.961600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] PATH_INFO: `/v3/projects/dbe19a61dc574dcc8fc45abe6c63cdaa` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:09.963162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe19a61dc574dcc8fc45abe6c63cdaa)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:09.965185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:10.012339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe19a61dc574dcc8fc45abe6c63cdaa', 'request_id': 'req-f9e87377-469a-448e-8555-b32be0357ddc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:10.018646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe19a61dc574dcc8fc45abe6c63cdaa', 'request_id': 'req-f9e87377-469a-448e-8555-b32be0357ddc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:10.026505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe19a61dc574dcc8fc45abe6c63cdaa', 'request_id': 'req-f9e87377-469a-448e-8555-b32be0357ddc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:10.037774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] The token cache is being invalidate because project dbe19a61dc574dcc8fc45abe6c63cdaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:00:10.038112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:10.038748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f9e87377-469a-448e-8555-b32be0357ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:00:10.040533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1133/2241] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:00:09 2022] DELETE /identity/v3/projects/dbe19a61dc574dcc8fc45abe6c63cdaa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:00:10.846058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702831a9-c9b4-48e5-903f-c388665022f3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:10.846568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702831a9-c9b4-48e5-903f-c388665022f3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:10.846568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702831a9-c9b4-48e5-903f-c388665022f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:10.871802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-702831a9-c9b4-48e5-903f-c388665022f3 None None] MFA Rules not processed for user `f7356d1144b14a4da1191729e2baafad`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:10.873066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-702831a9-c9b4-48e5-903f-c388665022f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:10.931779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1109/2242] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:00:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:20.034691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:20.924272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:26.840172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475611-fdca-42c2-82d7-427cd3b45eb8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:26.840774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475611-fdca-42c2-82d7-427cd3b45eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:26.843662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62475611-fdca-42c2-82d7-427cd3b45eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:26.864638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-62475611-fdca-42c2-82d7-427cd3b45eb8 None None] MFA Rules not processed for user `2c4ed6152a3b4e8c99e9896b531ecb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:26.866082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-62475611-fdca-42c2-82d7-427cd3b45eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:26.921630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1134/2243] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:33.332044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.332557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.332689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.353972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] MFA Rules not processed for user `c1ce97baf7cb4711812767724908a984`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:33.355420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:33.424666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1110/2244] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:33.931641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445e89-e4b0-4f46-800a-248f40f73051 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:33.932162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445e89-e4b0-4f46-800a-248f40f73051 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:33.932162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de445e89-e4b0-4f46-800a-248f40f73051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:33.952718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-de445e89-e4b0-4f46-800a-248f40f73051 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:33.953931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-de445e89-e4b0-4f46-800a-248f40f73051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.011107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1135/2245] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:34.053535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:34.055238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:34.133581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f8d8c-5c80-4846-a5e8-38035ca6ea8c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:34.140160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0f1b2-faeb-4c6a-a6ef-27ebc7f9540a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:34.140807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f1b2-faeb-4c6a-a6ef-27ebc7f9540a service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:34.141081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f1b2-faeb-4c6a-a6ef-27ebc7f9540a service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:34.141349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0f1b2-faeb-4c6a-a6ef-27ebc7f9540a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:34.149977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0f1b2-faeb-4c6a-a6ef-27ebc7f9540a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:34.151596 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0f1b2-faeb-4c6a-a6ef-27ebc7f9540a service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:34.159534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1111/2246] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:00:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:00:44.004957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=50 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:44.157510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=57 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:52.949605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47e848-fe9a-4201-8003-93d7ecbae93b None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:52.950191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47e848-fe9a-4201-8003-93d7ecbae93b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:52.950369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47e848-fe9a-4201-8003-93d7ecbae93b None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:52.951849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1136/2247] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 20:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:52.961124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119e0f1-79ec-4ef0-9234-cb382a608418 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:52.961765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119e0f1-79ec-4ef0-9234-cb382a608418 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:52.962358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119e0f1-79ec-4ef0-9234-cb382a608418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.015141 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f119e0f1-79ec-4ef0-9234-cb382a608418 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.016731 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f119e0f1-79ec-4ef0-9234-cb382a608418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.157672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1112/2248] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 20:00:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:53.169743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47e848-fe9a-4201-8003-93d7ecbae93b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.171707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4a47e848-fe9a-4201-8003-93d7ecbae93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.250665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47e848-fe9a-4201-8003-93d7ecbae93b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.255709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6510a-f8ae-4ec6-83d2-59cf5b6f0886 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.256592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6510a-f8ae-4ec6-83d2-59cf5b6f0886 service glance] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.256913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6510a-f8ae-4ec6-83d2-59cf5b6f0886 service glance] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.257203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6510a-f8ae-4ec6-83d2-59cf5b6f0886 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.272678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6510a-f8ae-4ec6-83d2-59cf5b6f0886 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.274428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6510a-f8ae-4ec6-83d2-59cf5b6f0886 service glance] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.286934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1137/2249] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:53.368773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec93c8d-be06-4388-9151-cb684ac10c27 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.369057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec93c8d-be06-4388-9151-cb684ac10c27 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.369330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec93c8d-be06-4388-9151-cb684ac10c27 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.370866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1113/2250] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 20:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:53.376573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18fce0-3b3e-4374-ae21-e0ab7d467b5e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.376972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18fce0-3b3e-4374-ae21-e0ab7d467b5e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.377339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18fce0-3b3e-4374-ae21-e0ab7d467b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.401022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bd18fce0-3b3e-4374-ae21-e0ab7d467b5e None None] MFA Rules not processed for user `5dbd68ef35a54c45baada1c45509985c`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.402247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bd18fce0-3b3e-4374-ae21-e0ab7d467b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.467314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1138/2251] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:53.479196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec93c8d-be06-4388-9151-cb684ac10c27 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.481024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1ec93c8d-be06-4388-9151-cb684ac10c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.494469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec93c8d-be06-4388-9151-cb684ac10c27 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.498996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9258a0-b917-499c-91a5-73b43be884f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.499713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9258a0-b917-499c-91a5-73b43be884f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.499988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9258a0-b917-499c-91a5-73b43be884f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.500780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9258a0-b917-499c-91a5-73b43be884f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.507522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9258a0-b917-499c-91a5-73b43be884f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.509080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9258a0-b917-499c-91a5-73b43be884f8 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.517516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1114/2252] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:53.607592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2e55-da2c-4862-94b4-272e8fd9b918 None None] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.607884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2e55-da2c-4862-94b4-272e8fd9b918 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.608154 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f2e55-da2c-4862-94b4-272e8fd9b918 None None] PATH_INFO: `/` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.609731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1139/2253] 10.222.0.65 () {54 vars in 921 bytes} [Tue Sep 13 20:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:53.622417 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca43e-e471-4ab2-9d65-20067f6ea4c4 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.622859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca43e-e471-4ab2-9d65-20067f6ea4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.623208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca43e-e471-4ab2-9d65-20067f6ea4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.645159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-319ca43e-e471-4ab2-9d65-20067f6ea4c4 None None] MFA Rules not processed for user `3a919420853a4ac8b461e303fc993429`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:53.646405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-319ca43e-e471-4ab2-9d65-20067f6ea4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:53.656129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1115/2254] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Sep 13 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:53.667322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f2e55-da2c-4862-94b4-272e8fd9b918 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:53.680602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f2e55-da2c-4862-94b4-272e8fd9b918 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:53.685045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:53.685667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:53.686298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:53.686574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:53.698820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:53.700537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:53.712982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1140/2255] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:54.362397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd351-9d23-49d7-9785-00837890c28c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.362871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd351-9d23-49d7-9785-00837890c28c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.362963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd351-9d23-49d7-9785-00837890c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.383904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-52ecd351-9d23-49d7-9785-00837890c28c None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:54.385236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-52ecd351-9d23-49d7-9785-00837890c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:54.392594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1116/2256] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:54.405426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:54.418765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70637-93ad-450e-ab1b-31bfea6fa21b service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:54.434562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:54.435561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:54.435945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:54.436432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:54.449718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:54.451430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:54.461069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1141/2257] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:00:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:00:56.673036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712745-c0ee-4199-9b56-91c7e7baf7f5 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:56.673605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712745-c0ee-4199-9b56-91c7e7baf7f5 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:56.673605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee712745-c0ee-4199-9b56-91c7e7baf7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:56.696206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ee712745-c0ee-4199-9b56-91c7e7baf7f5 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:56.697510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ee712745-c0ee-4199-9b56-91c7e7baf7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:56.706004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1117/2258] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:56.720361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:56.732846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b5073-e0a8-4159-952d-cd8aec563f0a service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:56.748019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:56.748748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:56.749208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:56.749977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:56.759212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:56.760891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:56.769463 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1142/2259] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:01:06.690633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=46 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:06.766655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=67 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:11.642204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:11.642773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:11.642773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:11.661969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:11.663177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:11.670535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1118/2260] 10.222.0.65 () {58 vars in 967 bytes} [Tue Sep 13 20:01:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:11.683894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:11.695122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89206e91-88ef-44c5-a177-8aa13b35478b service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:11.701880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:11.703021 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:11.703318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:11.703586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:11.716738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:11.718369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:11.727508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1143/2261] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:01:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:13.722239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:13.724238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:13.812543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c687f-49ea-41ee-942e-cc77e27882c9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:13.817606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:13.818182 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:13.818462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:13.818735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] PATH_INFO: `/v3/users/2c4ed6152a3b4e8c99e9896b531ecb4f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:13.819971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4ed6152a3b4e8c99e9896b531ecb4f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:13.822037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:13.875262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4ed6152a3b4e8c99e9896b531ecb4f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.885883 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4ed6152a3b4e8c99e9896b531ecb4f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.886528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4ed6152a3b4e8c99e9896b531ecb4f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.887210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4ed6152a3b4e8c99e9896b531ecb4f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.895545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ded700e0-9c39-4354-be69-5534c4e6802e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4ed6152a3b4e8c99e9896b531ecb4f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:13.914490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1119/2262] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:13 2022] DELETE /identity/v3/users/2c4ed6152a3b4e8c99e9896b531ecb4f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:14.094791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.109608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eaaed9-a418-47b5-9849-c392c3536708 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.172653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.173303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.173584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.173857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] PATH_INFO: `/v3/projects/d1e4432b477444c583a1c6067fd56949` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.175015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e4432b477444c583a1c6067fd56949)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.176947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.225000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e4432b477444c583a1c6067fd56949', 'request_id': 'req-797a0f32-4e5f-4012-9338-cd016c5c58a5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:14.232598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e4432b477444c583a1c6067fd56949', 'request_id': 'req-797a0f32-4e5f-4012-9338-cd016c5c58a5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:14.241218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e4432b477444c583a1c6067fd56949', 'request_id': 'req-797a0f32-4e5f-4012-9338-cd016c5c58a5'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:14.252516 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] The token cache is being invalidate because project d1e4432b477444c583a1c6067fd56949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:14.252839 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:14.253512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-797a0f32-4e5f-4012-9338-cd016c5c58a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:14.255956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1144/2263] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:14 2022] DELETE /identity/v3/projects/d1e4432b477444c583a1c6067fd56949 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:01:14.261483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bdb8b-2ec7-4294-b45f-23e849d439ce None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.261880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bdb8b-2ec7-4294-b45f-23e849d439ce None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.262156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bdb8b-2ec7-4294-b45f-23e849d439ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.282052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-499bdb8b-2ec7-4294-b45f-23e849d439ce None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:14.283258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-499bdb8b-2ec7-4294-b45f-23e849d439ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.341712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1120/2264] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:14.349487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.349769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.350042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.350834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ece18-f935-45ae-bc75-a72da0ea94d1 None None] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.351123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ece18-f935-45ae-bc75-a72da0ea94d1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.351393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ece18-f935-45ae-bc75-a72da0ea94d1 None None] PATH_INFO: `/` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.352828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1121/2265] 10.222.0.65 () {54 vars in 961 bytes} [Tue Sep 13 20:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 20:01:14.357279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.357558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.357856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.370922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:14.372511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.380882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] MFA Rules not processed for user `afb56a729d814fefaf904697e97fd33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:14.382072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1145/2266] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:14.382207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.386327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.392134 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:14.395888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627cd55-d48b-4c12-b1ec-a7ac779158ca None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.401207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.401815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.402085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.402354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.402997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:14.403291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.404894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.417675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1146/2267] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:14.422192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.432811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dfbed-23fc-4e0a-9deb-a8a32d674a79 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.437657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.438262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.438533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.438797 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.439421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.441350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.454105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1122/2268] 10.222.0.65 () {58 vars in 1058 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:14.461655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.470640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1147/2269] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:14.471033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6d19-5672-4e71-95f2-2f5fe7cd6d24 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.474823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.515426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:14.530753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.531372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.531666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.531931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.533700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.539224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a50a09-d632-469a-85e8-38d12d877135 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.543914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.544513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.544648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.544807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.545072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.545696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.546123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.547582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.555786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1123/2270] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:01:14.572812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1148/2271] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:14.574274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.584364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996eb47-7789-4606-a4c9-02a76dd6e1a7 service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.589015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.589605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.589882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.590150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.590777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.592443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.602036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1124/2272] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:14.606100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.616890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c36b83-39de-4319-9941-1b3e66f3a3e3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.623453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99417d-a523-4582-937b-9906bdac6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.623898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99417d-a523-4582-937b-9906bdac6d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.624190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99417d-a523-4582-937b-9906bdac6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.624434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99417d-a523-4582-937b-9906bdac6d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.625262 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99417d-a523-4582-937b-9906bdac6d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.626803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99417d-a523-4582-937b-9906bdac6d58 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.637371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1149/2273] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:14.643198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.653585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63879b77-6d14-4151-a8ec-e07083ca73e2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.658749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.659397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.659673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.659940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] PATH_INFO: `/v3/projects/b8a5e89776d04c1dba09fe5fbd1a79e4/users/8df41cea25814db5b4a11b2ad45e5dbb/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.678197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a5e89776d04c1dba09fe5fbd1a79e4, user_id=8df41cea25814db5b4a11b2ad45e5dbb, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.680889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.695131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1125/2274] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:14 2022] PUT /identity/v3/projects/b8a5e89776d04c1dba09fe5fbd1a79e4/users/8df41cea25814db5b4a11b2ad45e5dbb/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:14.706363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.706649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.706922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.738287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] MFA Rules not processed for user `8df41cea25814db5b4a11b2ad45e5dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:14.739514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.806920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1150/2275] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:14.818431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:14.820285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:14.880028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402f113-1a27-4207-840a-648c59720d9f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:14.883858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481b95c-7392-43bd-8807-b583e01f99bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:14.884513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b95c-7392-43bd-8807-b583e01f99bc service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:14.884820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b95c-7392-43bd-8807-b583e01f99bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:14.885119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481b95c-7392-43bd-8807-b583e01f99bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:14.894498 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481b95c-7392-43bd-8807-b583e01f99bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:14.896126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481b95c-7392-43bd-8807-b583e01f99bc service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:14.905971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1126/2276] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:19.963350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.002576 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.003117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.003117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.018213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:20.025136 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:20.027184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.042151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed433eb-187b-44cc-aa3d-d0c93e966c5e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.047511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.048224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.048657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.048983 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] PATH_INFO: `/v3/users/8df41cea25814db5b4a11b2ad45e5dbb` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.050241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df41cea25814db5b4a11b2ad45e5dbb)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.052251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.084855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1127/2277] 10.222.0.65 () {58 vars in 967 bytes} [Tue Sep 13 20:01:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:20.099725 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.101210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.108236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:20.113384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df41cea25814db5b4a11b2ad45e5dbb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.128592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df41cea25814db5b4a11b2ad45e5dbb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.129294 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df41cea25814db5b4a11b2ad45e5dbb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.129910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df41cea25814db5b4a11b2ad45e5dbb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.137341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5314bb51-3804-497e-b52d-3ce7911a57dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df41cea25814db5b4a11b2ad45e5dbb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.155493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1151/2278] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:01:19 2022] DELETE /identity/v3/users/8df41cea25814db5b4a11b2ad45e5dbb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:20.159745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.160029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.160304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.175427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f46b34-fec8-4ad2-9ffb-da5045a97424 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.179267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:20.180359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.238367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.238979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.239256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.239523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.240779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1152/2279] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:20.244070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.252396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.254123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.298545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:20.301394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.303146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.310721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee03655-c9eb-4b09-8497-fe8fc78ecb14 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.311678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1128/2280] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:01:20.315494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b635d80-e163-4c82-928a-8807da2b79ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.316244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635d80-e163-4c82-928a-8807da2b79ad service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.316631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635d80-e163-4c82-928a-8807da2b79ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.316992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b635d80-e163-4c82-928a-8807da2b79ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.326842 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b635d80-e163-4c82-928a-8807da2b79ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.328286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b635d80-e163-4c82-928a-8807da2b79ad service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.338134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1153/2281] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:20.614071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:20.616015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:20.632743 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac28a2-b0ed-4388-962b-7f5da841ada0 service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:20.639792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:20.640516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:20.641027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:20.641256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] PATH_INFO: `/v3/projects/b8a5e89776d04c1dba09fe5fbd1a79e4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:20.642426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a5e89776d04c1dba09fe5fbd1a79e4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:20.644481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:20.701161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a5e89776d04c1dba09fe5fbd1a79e4', 'request_id': 'req-76bb4521-e697-4a21-a91d-c7ff8e4acb50'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.707653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a5e89776d04c1dba09fe5fbd1a79e4', 'request_id': 'req-76bb4521-e697-4a21-a91d-c7ff8e4acb50'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.716767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a5e89776d04c1dba09fe5fbd1a79e4', 'request_id': 'req-76bb4521-e697-4a21-a91d-c7ff8e4acb50'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.728005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] The token cache is being invalidate because project b8a5e89776d04c1dba09fe5fbd1a79e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:01:20.728295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.729025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-76bb4521-e697-4a21-a91d-c7ff8e4acb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:01:20.730508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1129/2282] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:01:20 2022] DELETE /identity/v3/projects/b8a5e89776d04c1dba09fe5fbd1a79e4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:30.333971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=66,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:30.724704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:48.041925 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7700fb5-6dd4-47a9-b1ce-926a5275976d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:48.042423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7700fb5-6dd4-47a9-b1ce-926a5275976d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:48.042530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7700fb5-6dd4-47a9-b1ce-926a5275976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:48.061862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a7700fb5-6dd4-47a9-b1ce-926a5275976d None None] MFA Rules not processed for user `f7356d1144b14a4da1191729e2baafad`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:48.063045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a7700fb5-6dd4-47a9-b1ce-926a5275976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:48.119422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1154/2283] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:01:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:58.112364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=25 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:10.784353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4abb-7665-4fa1-ac96-4563e03b8397 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.784998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4abb-7665-4fa1-ac96-4563e03b8397 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.784998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a4abb-7665-4fa1-ac96-4563e03b8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.804700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-131a4abb-7665-4fa1-ac96-4563e03b8397 None None] MFA Rules not processed for user `285df012f70e4176ac99f05cd8271b44`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:10.805939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-131a4abb-7665-4fa1-ac96-4563e03b8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.864026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1130/2284] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:02:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:13.707355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:13.707968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:13.707968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:13.855488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] MFA Rules not processed for user `c1ce97baf7cb4711812767724908a984`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:13.856744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:13.912765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1155/2285] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:02:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:20.856097 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=25 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.906319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=25 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:36.120006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e087-0029-4c0c-8434-0707ceb6f620 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:36.120513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e087-0029-4c0c-8434-0707ceb6f620 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:36.120513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971e087-0029-4c0c-8434-0707ceb6f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:36.140099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9971e087-0029-4c0c-8434-0707ceb6f620 None None] MFA Rules not processed for user `cabb7c0ca0714384a8ad38890e12636b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:36.141336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9971e087-0029-4c0c-8434-0707ceb6f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:36.199239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1131/2286] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:02:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:46.192070 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=25 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:58.724247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:58.725874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:58.783947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a8f12-57ef-411c-a2f9-d76d368d178e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:58.787627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:58.788232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:58.788482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:58.788788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:58.790680 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:58.861547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:58.862982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:58.874447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1156/2287] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:01.902390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.902900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.902900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.922361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] MFA Rules not processed for user `f7356d1144b14a4da1191729e2baafad`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:01.923578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:01.931310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1132/2288] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:02.581436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.583485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.594656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5da7-c2ac-4766-a176-19e19cf01f78 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.598992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.599596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.599871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.600139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.602126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.615539 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.616990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.628841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1157/2289] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:11.917053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:12.623283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=60 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:21.821003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.823169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:21.843198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a321-8ace-49c2-b471-9f9869023376 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.852775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.854181 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.854453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.854710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.856829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:21.867662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:21.869281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.879161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1133/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:21.926679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.928996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:21.989943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e30124-6a2e-4d0e-ab56-d2ff75f06832 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.993997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.994618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.994893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.995162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.997039 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:22.008745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:22.010139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:22.019203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1158/2291] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:31.874719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:32.015193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=26 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:36.894677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:36.906106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54ba28-c772-4006-a5f1-14ee464fceb7 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:36.912878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:36.913540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:36.913821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:36.914109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:36.915921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:36.926815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:36.928387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d7eec-0a5c-4957-bc4a-d57b685932a8 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:36.937746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1134/2292] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:42.673109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:42.689838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a90e1-a99a-4f33-85b3-28346afe5eb5 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:42.698493 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:42.704974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:42.705862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:42.706326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:42.709133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:42.724038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:42.725741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:42.737088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1159/2293] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:43.184203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.185056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.185056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.206839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:43.208278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:43.271644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1135/2294] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:43.323139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:43.324592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:43.393322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f45a9-7aac-47c5-a3c1-cb8c3e3674bf service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:43.400781 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:43.401375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.401647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.401912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.411968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:43.413951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:43.425144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1160/2295] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:44.564084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:44.577060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36687c1c-fb8a-476c-850b-a70e76cc2f48 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:44.580808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:44.581549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:44.581834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:44.582111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:44.583890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:44.680642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:44.682421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:44.693855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1136/2296] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:48.925353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:48.927492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:48.965002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f7f9-4f13-4b79-a272-8eddb3f862be service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:48.970270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:48.971663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:48.972422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:48.972536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] PATH_INFO: `/v3/users/c1ce97baf7cb4711812767724908a984` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:48.974041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ce97baf7cb4711812767724908a984)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:48.975950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.047505 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ce97baf7cb4711812767724908a984'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.059383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ce97baf7cb4711812767724908a984'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.060387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ce97baf7cb4711812767724908a984'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.061253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ce97baf7cb4711812767724908a984'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.070885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ea1e1fc1-ece3-4610-8ada-72982a211e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ce97baf7cb4711812767724908a984'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.105414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1161/2297] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:48 2022] DELETE /identity/v3/users/c1ce97baf7cb4711812767724908a984 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:49.310410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.324651 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec0b93-4428-4ea5-b55a-bfdfee04e905 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.414067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.414878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.415210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.415544 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] PATH_INFO: `/v3/projects/29d85efb54b2496b90f5b407e4674381` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.416784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d85efb54b2496b90f5b407e4674381)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.418960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.469641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:49.489226 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d85efb54b2496b90f5b407e4674381', 'request_id': 'req-3989cf20-a2cd-4193-9bb0-4856476ddf4b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.499305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d85efb54b2496b90f5b407e4674381', 'request_id': 'req-3989cf20-a2cd-4193-9bb0-4856476ddf4b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.508863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d85efb54b2496b90f5b407e4674381', 'request_id': 'req-3989cf20-a2cd-4193-9bb0-4856476ddf4b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.523254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] The token cache is being invalidate because project 29d85efb54b2496b90f5b407e4674381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:49.523678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.524426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3989cf20-a2cd-4193-9bb0-4856476ddf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.526062 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1137/2298] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:49 2022] DELETE /identity/v3/projects/29d85efb54b2496b90f5b407e4674381 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:49.531259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.531549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.531824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.554168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:49.555395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:49.607270 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:49.626534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1162/2299] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:49.634444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.634728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.634990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.658949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:49.660178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:49.675610 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1138/2300] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:49.677080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.689107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fe1d2-e25d-4807-9ab5-f91432085e78 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.693851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.694701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.694984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.695256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.696040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:49.696346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.697994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.716358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1163/2301] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:49.717650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.730569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3a51a-a718-42ee-b962-a7d4b54dc055 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.736482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.737173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.737445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.737717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.738358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.740269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.784664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1139/2302] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:49 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:49.788261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.802414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0c3a-a714-4b96-8396-4b609885fa84 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.883609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.884692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.885178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.885647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.888297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.891404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.923637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1164/2303] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:49 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:49.927968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.943186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c951dc-4485-4135-a932-2ceaa449f311 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.949897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.950525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.952133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.952133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.952133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.953422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.967663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1140/2304] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:49.971730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.988422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f83b8-5e7e-4870-9e6e-3980a77db5f4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.996689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f5f8-5602-46c5-960f-c9785d467034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.997325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f5f8-5602-46c5-960f-c9785d467034 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.997734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f5f8-5602-46c5-960f-c9785d467034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.998171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f5f8-5602-46c5-960f-c9785d467034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.999002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f5f8-5602-46c5-960f-c9785d467034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.001837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f5f8-5602-46c5-960f-c9785d467034 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.014351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1165/2305] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:50.018962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.029706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2a725-1706-4d0c-be95-fda3b7f14a5b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.035021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.035789 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.036194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.036561 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] PATH_INFO: `/v3/projects/2e575b296df84fda867f028f1cefeca9/users/8f0f9fa8a4794e99bae346eebdd23503/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.053846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e575b296df84fda867f028f1cefeca9, user_id=8f0f9fa8a4794e99bae346eebdd23503, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.056513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.072276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1141/2306] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:50 2022] PUT /identity/v3/projects/2e575b296df84fda867f028f1cefeca9/users/8f0f9fa8a4794e99bae346eebdd23503/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:50.083560 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.084127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.084535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.117296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] MFA Rules not processed for user `8f0f9fa8a4794e99bae346eebdd23503`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:50.118774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:50.210118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1166/2307] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:50.215582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.307207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e419bfc-09ad-40f3-9f6c-3ace5b0ed4a0 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.312375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.313688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.314176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.315032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.316785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.319858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.377130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1142/2308] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:50.381350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.392636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3ba56-00e8-41c2-9109-03477858ef8f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.475849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:50.511742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.512903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.513186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.513453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.514108 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.517385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.543446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1167/2309] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:50.547518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.558913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3ec42-c981-4774-82eb-d5251f34db99 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.566362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.566992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.567266 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.567580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.568231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.569914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.585487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1143/2310] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:50.589572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.601923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29247a5b-be27-4726-9593-8d71bf36e305 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.608638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.609428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.609804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.610199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] PATH_INFO: `/v3/projects/69f537a1aaf24871ac06a6efd333da38/users/462fc6aa1cad4bf19fa6c62ff3f5bb1b/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.628809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f537a1aaf24871ac06a6efd333da38, user_id=462fc6aa1cad4bf19fa6c62ff3f5bb1b, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.631528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.647644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1168/2311] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:50 2022] PUT /identity/v3/projects/69f537a1aaf24871ac06a6efd333da38/users/462fc6aa1cad4bf19fa6c62ff3f5bb1b/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:50.651683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.663766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393f6dc-bd90-4ff1-8aac-e65fc2d8aad6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.692366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:50.730836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83529d2d-8e85-449e-8e12-c77fb9a6f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.731579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529d2d-8e85-449e-8e12-c77fb9a6f656 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.731948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529d2d-8e85-449e-8e12-c77fb9a6f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.732279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529d2d-8e85-449e-8e12-c77fb9a6f656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.733033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83529d2d-8e85-449e-8e12-c77fb9a6f656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.734713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83529d2d-8e85-449e-8e12-c77fb9a6f656 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.750696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1144/2312] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:50.751864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.764860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df7899-6817-47c4-8883-8b9ebe2278f4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.769200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.770013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.770289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.770554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] PATH_INFO: `/v3/projects/69f537a1aaf24871ac06a6efd333da38/users/462fc6aa1cad4bf19fa6c62ff3f5bb1b/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.772506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f537a1aaf24871ac06a6efd333da38, user_id=462fc6aa1cad4bf19fa6c62ff3f5bb1b, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.775177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.793515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1169/2313] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:50 2022] PUT /identity/v3/projects/69f537a1aaf24871ac06a6efd333da38/users/462fc6aa1cad4bf19fa6c62ff3f5bb1b/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:50.797152 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.797436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.797715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.827462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] MFA Rules not processed for user `462fc6aa1cad4bf19fa6c62ff3f5bb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:50.828857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:50.920158 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1145/2314] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:50.932422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.935709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.017322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871bc0-b99c-431e-84dd-f58c9cb5be72 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.021462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.022211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.022491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.022750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.039778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.042649 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.059886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1170/2315] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:51.164737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.180373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c66a-a485-4113-8236-cc1839d849e9 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.187187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.188444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.188965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.189448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.263272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.264842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.276354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1146/2316] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:54.709370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:54.711178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:54.784156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebf642-97f8-4303-b844-86103a75df1a service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:54.787965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:54.788575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:54.788931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:54.789204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:54.790965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:54.800814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:54.802308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:54.810879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1171/2317] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:58.465977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.534749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:58.563306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.566096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.576304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0288156-f9b4-496f-988b-7eb911df0c22 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.581123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.581771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.582049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.582347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] PATH_INFO: `/v3/users/8f0f9fa8a4794e99bae346eebdd23503` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.583534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0f9fa8a4794e99bae346eebdd23503)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.585626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.647243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:58.670742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0f9fa8a4794e99bae346eebdd23503'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.680068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0f9fa8a4794e99bae346eebdd23503'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.680753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0f9fa8a4794e99bae346eebdd23503'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.681347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0f9fa8a4794e99bae346eebdd23503'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.684536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04074a3-ea9e-4801-a898-e6eb3d1bdf4c service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.689244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0f9fa8a4794e99bae346eebdd23503'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.692043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.692883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.693314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.693736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.695873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.708674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1147/2318] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:58 2022] DELETE /identity/v3/users/8f0f9fa8a4794e99bae346eebdd23503 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:58.709055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.709736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.710961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507ade1-cfc9-471b-ab97-c2bdc9c7db62 service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.711422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.728809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1172/2319] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:58.731188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.731480 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.732989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.757237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:58.758591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.800956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228cea-a393-4f10-aada-abc3da399193 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.806414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.807160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.807442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.807718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.809674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.821542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.823178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.826074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1173/2320] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:58.834140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1148/2321] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:58.839640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.841361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.903004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559839a5-ce5a-43ce-80bb-3f1abd973258 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.911938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.912713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.913007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.913334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.924170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.925777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.936885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1174/2322] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:59.220225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:59.222334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:59.236756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca812a24-d42f-4cba-971e-d61eed9d33dd service placement] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:59.241257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:59.241913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:59.242192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:59.242463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] PATH_INFO: `/v3/projects/2e575b296df84fda867f028f1cefeca9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:59.243668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e575b296df84fda867f028f1cefeca9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:59.245929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:59.296552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e575b296df84fda867f028f1cefeca9', 'request_id': 'req-f13e632a-69a9-41ba-98cc-808791b7b8f9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.297778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:59.304641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e575b296df84fda867f028f1cefeca9', 'request_id': 'req-f13e632a-69a9-41ba-98cc-808791b7b8f9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.314167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e575b296df84fda867f028f1cefeca9', 'request_id': 'req-f13e632a-69a9-41ba-98cc-808791b7b8f9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.325102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] The token cache is being invalidate because project 2e575b296df84fda867f028f1cefeca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:59.325390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.326146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.327683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1149/2323] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:59 2022] DELETE /identity/v3/projects/2e575b296df84fda867f028f1cefeca9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:59.331615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:59.341327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20450479-e92f-4106-8c14-22070a15be04 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:59.398231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:59.399211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:59.399211 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:59.399890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] PATH_INFO: `/v3/users/462fc6aa1cad4bf19fa6c62ff3f5bb1b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:59.400660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462fc6aa1cad4bf19fa6c62ff3f5bb1b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:59.402780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:59.417511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:59.460101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462fc6aa1cad4bf19fa6c62ff3f5bb1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.468145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462fc6aa1cad4bf19fa6c62ff3f5bb1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.468854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462fc6aa1cad4bf19fa6c62ff3f5bb1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.469458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462fc6aa1cad4bf19fa6c62ff3f5bb1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.476175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c9d5ad1e-1b50-498b-afb5-c4c5e3569b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462fc6aa1cad4bf19fa6c62ff3f5bb1b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:59.493927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1175/2324] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:59 2022] DELETE /identity/v3/users/462fc6aa1cad4bf19fa6c62ff3f5bb1b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:59.850461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:59.852016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:59.867377 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e632a-69a9-41ba-98cc-808791b7b8f9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:59.942362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:59.943588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:59.943990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:59.944343 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] PATH_INFO: `/v3/projects/69f537a1aaf24871ac06a6efd333da38` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:59.945702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f537a1aaf24871ac06a6efd333da38)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:59.947784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.003468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f537a1aaf24871ac06a6efd333da38', 'request_id': 'req-be7e6c10-a58d-4384-82a2-ddd21652b1ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:00.010962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f537a1aaf24871ac06a6efd333da38', 'request_id': 'req-be7e6c10-a58d-4384-82a2-ddd21652b1ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:00.019631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f537a1aaf24871ac06a6efd333da38', 'request_id': 'req-be7e6c10-a58d-4384-82a2-ddd21652b1ba'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:00.030393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] The token cache is being invalidate because project 69f537a1aaf24871ac06a6efd333da38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:00.032431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:00.032431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:00.034001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1150/2325] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:59 2022] DELETE /identity/v3/projects/69f537a1aaf24871ac06a6efd333da38 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:00.038817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe27-bc70-47f9-bd37-68c86886b5e6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.039331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe27-bc70-47f9-bd37-68c86886b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.039466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe27-bc70-47f9-bd37-68c86886b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.041030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.042700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.062985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f37cfe27-bc70-47f9-bd37-68c86886b5e6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:00.065065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f37cfe27-bc70-47f9-bd37-68c86886b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.145779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1176/2326] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:00.153715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.154251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.154596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.155664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e6c10-a58d-4384-82a2-ddd21652b1ba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.161351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.162624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.162624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.163007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.165058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.170420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:00.175453 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:00.176974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.187417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1177/2327] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:00.192495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.204013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cca8c1-7482-40f4-8192-8d801bf943ff None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.209563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.210290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.210568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.210837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.212050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:00.212050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.213512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.228812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1178/2328] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:00.230599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.239702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.241314 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.250258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff831-bff5-4e35-8180-962e1814b24e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.253783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1151/2329] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:00.257001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.257679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.258085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.258474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.259145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.261430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.293240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1179/2330] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/projects => generated 407 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:00.298254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.311424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67a9a-24cc-471c-b0f7-1023d05c6eb8 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.382487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.383391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.383967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.384247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.384935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.388755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.415776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1152/2331] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/users => generated 304 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:00.419909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.432575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eaa452-503c-43b0-975d-1af3dc171305 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.438117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.438965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.439249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.439515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.440156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.442137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.453107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1180/2332] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:00.457545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.468340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551cf4b-dac1-4929-83b0-b23249f8b374 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.473052 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622bf63-1f82-40ad-9fc3-99fb8579ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.473642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622bf63-1f82-40ad-9fc3-99fb8579ef87 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.473915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622bf63-1f82-40ad-9fc3-99fb8579ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.474178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622bf63-1f82-40ad-9fc3-99fb8579ef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.474812 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622bf63-1f82-40ad-9fc3-99fb8579ef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.476396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622bf63-1f82-40ad-9fc3-99fb8579ef87 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.487042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1153/2333] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:00.491442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.502070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5d71-2b2c-478b-86ff-7acd897d5cad admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.506699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59031-a3ee-4432-b317-f345340d121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.507381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59031-a3ee-4432-b317-f345340d121a admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.507654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59031-a3ee-4432-b317-f345340d121a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.507923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59031-a3ee-4432-b317-f345340d121a admin admin] PATH_INFO: `/v3/projects/9f6eb71deee94959b38d3cc9d1940880/users/140ac992f5764dc488871ce4f17998ae/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.525679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59031-a3ee-4432-b317-f345340d121a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6eb71deee94959b38d3cc9d1940880, user_id=140ac992f5764dc488871ce4f17998ae, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.528422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59031-a3ee-4432-b317-f345340d121a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.544762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1181/2334] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:00 2022] PUT /identity/v3/projects/9f6eb71deee94959b38d3cc9d1940880/users/140ac992f5764dc488871ce4f17998ae/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:00.557641 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.558032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.558408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.587525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.587813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.588075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.605420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] MFA Rules not processed for user `140ac992f5764dc488871ce4f17998ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:00.606847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.613001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:00.614209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.635240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:00.680442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1182/2335] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:00.691600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1154/2336] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:00.696325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.696459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.697799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:00.709164 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:00.759488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3e3d2-7883-4a1d-b323-570e6fce8e6d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.764440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.765055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.765331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.765713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.766349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.768248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.770005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54de9b-f5ab-4faa-a43a-7dd1a847bf81 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.775596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.776315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.776596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.776891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.785426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.786999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.796233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1183/2337] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:04:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:04:00.804730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1155/2338] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/projects => generated 409 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:00.806120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.823840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf821-28cf-4953-b9a8-7dc8d8dbf7be service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:00.904773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:00.905427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:00.906795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:00.907065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:00.908289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:00.911753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:00.966127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1184/2339] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:00 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:00.971337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:00.993528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76738-4424-4c77-85c4-305e75612aea admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.004730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.005635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.006147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.006528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.008154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.011282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.030394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1156/2340] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:01.034132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:01.046048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7c550-8eef-4ed4-8320-a9abf02caeff admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.053029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.054118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.054693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.055352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] PATH_INFO: `/v3/projects/d48ac6cae5b34d3c80a8df5375be46eb/users/be3fbb3a21744c46b011f10c0bdfafec/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.084088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48ac6cae5b34d3c80a8df5375be46eb, user_id=be3fbb3a21744c46b011f10c0bdfafec, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.087473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.113906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1185/2341] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:01 2022] PUT /identity/v3/projects/d48ac6cae5b34d3c80a8df5375be46eb/users/be3fbb3a21744c46b011f10c0bdfafec/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:01.118246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:01.130723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4ca36-87c0-44e4-823e-0e48f8cea258 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.250458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2299f26-c492-452f-b743-699daeb9c3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.251131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2299f26-c492-452f-b743-699daeb9c3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.253318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2299f26-c492-452f-b743-699daeb9c3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.253318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2299f26-c492-452f-b743-699daeb9c3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.253318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2299f26-c492-452f-b743-699daeb9c3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.257784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2299f26-c492-452f-b743-699daeb9c3ac admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.274495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1157/2342] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:01.278642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:01.304355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b721-36b3-4fef-b45e-5c397beec526 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.314824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.315750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.317205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.317841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] PATH_INFO: `/v3/projects/d48ac6cae5b34d3c80a8df5375be46eb/users/be3fbb3a21744c46b011f10c0bdfafec/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.322193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48ac6cae5b34d3c80a8df5375be46eb, user_id=be3fbb3a21744c46b011f10c0bdfafec, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.330230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.361803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:01.368566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1186/2343] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:01 2022] PUT /identity/v3/projects/d48ac6cae5b34d3c80a8df5375be46eb/users/be3fbb3a21744c46b011f10c0bdfafec/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:01.380223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.380911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.381201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.413342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] MFA Rules not processed for user `be3fbb3a21744c46b011f10c0bdfafec`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:01.413570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:01.525080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1158/2344] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:01.536336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:01.539059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:01.607865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc602-477e-481b-a76a-6177dc278dc9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.612814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.613715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.614140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.614554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.627575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.629107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.641807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1187/2345] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:01.843828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:01.845838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:01.859150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd907ca7-c3e1-44c0-a735-dc5191982834 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.863118 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.863993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.863993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.865339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.872254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:01.940825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.942370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.952454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1159/2346] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:02.545147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:02.546573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:02.613507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42167674-d31d-4935-9c3e-d7bc638287b2 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:02.618631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:02.620006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:02.620355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:02.620683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:02.623663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:02.703277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:02.705149 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:02.716072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1188/2347] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:07.197786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:07.199428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:07.237753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eeb167-8685-4a8c-a840-d758f3da8e28 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:07.243858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:07.244776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:07.245234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:07.245662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] PATH_INFO: `/v3/users/cabb7c0ca0714384a8ad38890e12636b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:07.246902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabb7c0ca0714384a8ad38890e12636b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:07.249239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:07.327283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabb7c0ca0714384a8ad38890e12636b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.346674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabb7c0ca0714384a8ad38890e12636b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.347496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabb7c0ca0714384a8ad38890e12636b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.348204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabb7c0ca0714384a8ad38890e12636b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.361178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2e527d8b-5121-422e-9cd7-00d0b985a138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabb7c0ca0714384a8ad38890e12636b'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.398386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1160/2348] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:07 2022] DELETE /identity/v3/users/cabb7c0ca0714384a8ad38890e12636b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:07.609495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:07.619445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5d8d-c2ba-45d2-a2f2-a01346a856be service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:07.672902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:07.684191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:07.685072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:07.685326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:07.685594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] PATH_INFO: `/v3/projects/062abfa9c3354463a3db8486dea5413a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:07.686740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062abfa9c3354463a3db8486dea5413a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:07.688681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:07.789618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062abfa9c3354463a3db8486dea5413a', 'request_id': 'req-19d36acd-9f85-4c57-8ec2-91b242af2876'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.796162 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062abfa9c3354463a3db8486dea5413a', 'request_id': 'req-19d36acd-9f85-4c57-8ec2-91b242af2876'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.808238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062abfa9c3354463a3db8486dea5413a', 'request_id': 'req-19d36acd-9f85-4c57-8ec2-91b242af2876'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.822722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] The token cache is being invalidate because project 062abfa9c3354463a3db8486dea5413a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:07.823517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.824556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19d36acd-9f85-4c57-8ec2-91b242af2876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:07.826847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1189/2349] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:07 2022] DELETE /identity/v3/projects/062abfa9c3354463a3db8486dea5413a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:07.831855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:07.832132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:07.832407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:07.855374 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:07.856637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:07.946470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1161/2350] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:07.956292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:07.956292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:07.956292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:07.972647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:07.974466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:07.987635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52fb53-cfb9-4c98-b63a-03a0a89b4ef6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:07.992697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:07.993353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:07.993628 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:07.993892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] PATH_INFO: `/v3/users/140ac992f5764dc488871ce4f17998ae` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:07.995025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=140ac992f5764dc488871ce4f17998ae)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:07.995535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:07.996976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:07.997130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.015237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:08.024436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1190/2351] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:08.029450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.040322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e576ab-dfa9-4c87-8457-a6f1ca5f096a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.045398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.046034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.046317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.046584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.047399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:08.047601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.049371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.065915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1191/2352] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:04:08.066814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.075103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140ac992f5764dc488871ce4f17998ae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.077582 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72d5a4-b515-4de5-91fb-b135424b940d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.082423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.083081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.083363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.083631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.084316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.086363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140ac992f5764dc488871ce4f17998ae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.086513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.087292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140ac992f5764dc488871ce4f17998ae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.088259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140ac992f5764dc488871ce4f17998ae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.109911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1a3549ed-cfdd-44ab-b557-df7723b81e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140ac992f5764dc488871ce4f17998ae'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.120655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1192/2353] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:08 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:08.123369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.125389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:08.135976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1162/2354] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:07 2022] DELETE /identity/v3/users/140ac992f5764dc488871ce4f17998ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:08.135976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.135976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.135976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.156902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:08.158130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:08.216666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac069f4-4d95-4eed-aba6-c8286708cefb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.234990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1163/2355] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:08.246892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.248391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:08.271387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:08.287563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.288175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.288449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.288753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.289410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.291321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.310475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f616b5-0f8c-4944-b84e-cad8ef90b3f6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.315224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.315930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.316278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.316631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.317843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1193/2356] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:08 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:08.321984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.329268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.330783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.332019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d6e66-4632-4944-ab5e-535d60966ff6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.337707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.338319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.338599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.338870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.339568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.341207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.342514 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1164/2357] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:08.353466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1194/2358] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:08.357540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.367988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a87d-5d7d-4b80-beee-6dccc82b339e service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.375781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c2020-62d4-4a51-9faf-fb6aa52ca988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.376402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2020-62d4-4a51-9faf-fb6aa52ca988 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.376715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2020-62d4-4a51-9faf-fb6aa52ca988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.378026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c2020-62d4-4a51-9faf-fb6aa52ca988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.378282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c2020-62d4-4a51-9faf-fb6aa52ca988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.379895 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c2020-62d4-4a51-9faf-fb6aa52ca988 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.391912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1165/2359] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:08.396361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.407741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f909-acf6-4fe4-9996-77776e7399a2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.412553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.413248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.413655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.413956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] PATH_INFO: `/v3/projects/c94a8e80077f443bac7ccf58f2d27791/users/21f46edc9f8a47a08ea9e069f57d79a1/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.435426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94a8e80077f443bac7ccf58f2d27791, user_id=21f46edc9f8a47a08ea9e069f57d79a1, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.438813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.454849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1195/2360] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:08 2022] PUT /identity/v3/projects/c94a8e80077f443bac7ccf58f2d27791/users/21f46edc9f8a47a08ea9e069f57d79a1/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:08.467269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.467269 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.467550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.497393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] MFA Rules not processed for user `21f46edc9f8a47a08ea9e069f57d79a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:08.498775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:08.518912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:08.585955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1166/2361] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:08.596953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.598820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:08.645716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.647241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:08.665325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dbdb9-e631-44da-847b-e3ff5e835b7c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.669156 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.669685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.670069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.670222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.679196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.680818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.690590 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1196/2362] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:08.723459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969573d-70db-466c-b40f-cf4de5965194 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.728309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.729053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.729328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.729607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] PATH_INFO: `/v3/projects/9f6eb71deee94959b38d3cc9d1940880` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.730734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6eb71deee94959b38d3cc9d1940880)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.732660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.781742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6eb71deee94959b38d3cc9d1940880', 'request_id': 'req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.788183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6eb71deee94959b38d3cc9d1940880', 'request_id': 'req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.798709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6eb71deee94959b38d3cc9d1940880', 'request_id': 'req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.812635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] The token cache is being invalidate because project 9f6eb71deee94959b38d3cc9d1940880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:08.812942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.813622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.815315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1167/2363] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:08 2022] DELETE /identity/v3/projects/9f6eb71deee94959b38d3cc9d1940880 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:08.820044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:08.832099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25977f2-9899-4eca-b145-71d425146e11 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:08.895249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:08.895973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:08.896322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:08.896596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] PATH_INFO: `/v3/users/be3fbb3a21744c46b011f10c0bdfafec` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:08.897931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3fbb3a21744c46b011f10c0bdfafec)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:08.900268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:08.950550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3fbb3a21744c46b011f10c0bdfafec'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.952353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:08.969246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3fbb3a21744c46b011f10c0bdfafec'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.969945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3fbb3a21744c46b011f10c0bdfafec'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.970584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3fbb3a21744c46b011f10c0bdfafec'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:08.983055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6797448f-b417-4fd3-b774-62e2891dbfe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3fbb3a21744c46b011f10c0bdfafec'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:09.004901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1197/2364] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:08 2022] DELETE /identity/v3/users/be3fbb3a21744c46b011f10c0bdfafec => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:09.285929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.287444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:09.302166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7603a-35a7-4182-b09d-a4f4a6a3fd4d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.346383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:09.362412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.363039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.363316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.363583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] PATH_INFO: `/v3/projects/d48ac6cae5b34d3c80a8df5375be46eb` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.364711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48ac6cae5b34d3c80a8df5375be46eb)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.366622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.413466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48ac6cae5b34d3c80a8df5375be46eb', 'request_id': 'req-7f04886e-6474-4dd8-b23d-20cc6ef1893f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:09.419638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48ac6cae5b34d3c80a8df5375be46eb', 'request_id': 'req-7f04886e-6474-4dd8-b23d-20cc6ef1893f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:09.428757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48ac6cae5b34d3c80a8df5375be46eb', 'request_id': 'req-7f04886e-6474-4dd8-b23d-20cc6ef1893f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:09.445371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] The token cache is being invalidate because project d48ac6cae5b34d3c80a8df5375be46eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:09.445764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:09.446552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f04886e-6474-4dd8-b23d-20cc6ef1893f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:09.448200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1168/2365] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:09 2022] DELETE /identity/v3/projects/d48ac6cae5b34d3c80a8df5375be46eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:09.453293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.453576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.453849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.474696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:09.475914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:09.535731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1198/2366] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:09.545640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.545940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.546443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.574112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:09.575332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:09.584734 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1169/2367] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:09.589812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.604756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df406c2a-c564-47a6-99bb-44f95d6f6d8e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.612411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.613197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.613595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.613977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.615317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:09.615717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.617622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.632660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1199/2368] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:09.635955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.647679 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17d339-43f6-4887-9e01-3d5d7848d3aa None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.656333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.657312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.657552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.657817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.658467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.660510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.697017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1170/2369] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:09 2022] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:09.701152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.714339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad457-789f-458e-af71-7b81eba71d18 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.793646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.794325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.794659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.794964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.795607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.797579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.827240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1200/2370] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:09 2022] POST /identity/v3/users => generated 281 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:09.831252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.841559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc418ef-0408-4b48-9ef7-1c2fcefe3a8f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.846241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.846850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.847124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.847393 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.848035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.849759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.860716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1171/2371] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:09.864833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.875528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e625-b7a3-4e3b-b710-3812366e3828 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.880357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379dabd5-5033-47f0-8daa-819aae6852f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.881003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dabd5-5033-47f0-8daa-819aae6852f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.881283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dabd5-5033-47f0-8daa-819aae6852f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.881554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379dabd5-5033-47f0-8daa-819aae6852f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.882196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dabd5-5033-47f0-8daa-819aae6852f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.883863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379dabd5-5033-47f0-8daa-819aae6852f5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.896343 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1201/2372] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:09.900906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:09.913805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782accc-c822-4052-9576-9abb4f6e2aee admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:09.919800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:09.920470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.920831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.921796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] PATH_INFO: `/v3/projects/44b21bc99a0c40149350ea939f81620d/users/e75194835bbc4cd8addbd3dfec32056a/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.940117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b21bc99a0c40149350ea939f81620d, user_id=e75194835bbc4cd8addbd3dfec32056a, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:09.943043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:09.959234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1172/2373] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:09 2022] PUT /identity/v3/projects/44b21bc99a0c40149350ea939f81620d/users/e75194835bbc4cd8addbd3dfec32056a/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:09.971051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:09.971324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:09.971594 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:09.999783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] MFA Rules not processed for user `e75194835bbc4cd8addbd3dfec32056a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:10.001549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:10.021328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:10.083887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1202/2374] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:10.119984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:10.122407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:10.192203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a55b77-4f91-4d06-9ce0-43bcb67146e4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:10.196240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f519f-706e-43a8-8b8a-7594979ee17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:10.196876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f519f-706e-43a8-8b8a-7594979ee17c service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:10.197149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f519f-706e-43a8-8b8a-7594979ee17c service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:10.197412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f519f-706e-43a8-8b8a-7594979ee17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:10.205963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f519f-706e-43a8-8b8a-7594979ee17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:10.207521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f519f-706e-43a8-8b8a-7594979ee17c service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:10.216501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1173/2375] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:10.232040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:10.296585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb8f1b-ac62-4835-b55c-8089bae4d7e9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:10.301592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:10.302259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:10.302507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:10.302778 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] PATH_INFO: `/v3/users/e75194835bbc4cd8addbd3dfec32056a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:10.303914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75194835bbc4cd8addbd3dfec32056a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:10.305977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:10.357627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75194835bbc4cd8addbd3dfec32056a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:10.367859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75194835bbc4cd8addbd3dfec32056a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:10.369378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75194835bbc4cd8addbd3dfec32056a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:10.370372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75194835bbc4cd8addbd3dfec32056a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:10.379634 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75194835bbc4cd8addbd3dfec32056a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:10.414752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1203/2376] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:10 2022] DELETE /identity/v3/users/e75194835bbc4cd8addbd3dfec32056a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:10.414850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:10.414850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:10.414850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:10.453807 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:10.455284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:10.466139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:10.537309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1174/2377] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:10.550316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:10.551714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:10.597795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:10.614371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5320f86-545e-4c7f-99da-0106cdcab11a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:10.618847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2723dd-2d8e-4a75-ad47-03f9ef638ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:10.619464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2723dd-2d8e-4a75-ad47-03f9ef638ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:10.619736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2723dd-2d8e-4a75-ad47-03f9ef638ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:10.620002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2723dd-2d8e-4a75-ad47-03f9ef638ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:10.630187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2723dd-2d8e-4a75-ad47-03f9ef638ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:10.631705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2723dd-2d8e-4a75-ad47-03f9ef638ed5 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:10.641311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1204/2378] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:10.966303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:10.969963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:10.988091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0391b-950e-43e1-9617-2d1eef932592 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.000994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.005075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.005457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.005618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] PATH_INFO: `/v3/projects/44b21bc99a0c40149350ea939f81620d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.006873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b21bc99a0c40149350ea939f81620d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.008900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.097788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b21bc99a0c40149350ea939f81620d', 'request_id': 'req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.105823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b21bc99a0c40149350ea939f81620d', 'request_id': 'req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.118256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b21bc99a0c40149350ea939f81620d', 'request_id': 'req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.131114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] The token cache is being invalidate because project 44b21bc99a0c40149350ea939f81620d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:11.131403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.132099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bbc62b70-df78-4f8c-8fe6-db850dcd8f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.139401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1175/2379] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:10 2022] DELETE /identity/v3/projects/44b21bc99a0c40149350ea939f81620d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:11.140993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.141807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.142087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.162557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:11.163980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:11.228967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1205/2380] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:11.236809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.237099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.237373 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.261162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:11.262172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:11.270376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1176/2381] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:11.274482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.285197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c72cef-8474-4429-98ea-5ce05be32fd3 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.290088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.290694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.290971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.291238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.291884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:11.292187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.293827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.306221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1206/2382] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:11.310510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.320885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6495e-d7cc-415b-94af-950e90007a6b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.326446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.327210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.327542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.327817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.328456 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.330492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.360391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1177/2383] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:11 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:11.364752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.375661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3772a5-b333-463e-ad03-604ccb21aa51 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.433057 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.433660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.433931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.434193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.434847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.436755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.460111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1207/2384] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:11 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:11.464543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.475302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532354b-ab2d-49a9-b89b-85e7bbabfd42 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.480571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.481375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.481748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.482102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.482797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.484515 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.495863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1178/2385] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:11.500836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.511862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58c79-9fa2-48ae-bf13-0ef3fac1e38a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.519297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc686-42a4-424b-a4e6-d7d68edb5154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.520400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc686-42a4-424b-a4e6-d7d68edb5154 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.520862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc686-42a4-424b-a4e6-d7d68edb5154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.521583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc686-42a4-424b-a4e6-d7d68edb5154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.522682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc686-42a4-424b-a4e6-d7d68edb5154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.524442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc686-42a4-424b-a4e6-d7d68edb5154 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.537552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1208/2386] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:11.541954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.553464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d02610-ef39-4486-a762-1cbf29efa249 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.559934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.560675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.560925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.561193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] PATH_INFO: `/v3/projects/4837bfefc1154a8b91ae0220896e9173/users/3e7013e22c8a4c6b87c8d023ad6309af/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.578436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4837bfefc1154a8b91ae0220896e9173, user_id=3e7013e22c8a4c6b87c8d023ad6309af, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.581333 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.596811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1179/2387] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:11 2022] PUT /identity/v3/projects/4837bfefc1154a8b91ae0220896e9173/users/3e7013e22c8a4c6b87c8d023ad6309af/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:11.608298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.608585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.608896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.638393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] MFA Rules not processed for user `3e7013e22c8a4c6b87c8d023ad6309af`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:11.639605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:11.680561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:11.708497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1209/2388] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:11.720321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.722217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:11.761913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:11.786281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b40b-643d-40c3-a3b2-fb830df5040e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.790027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98c592-da0b-429b-9489-841cf1599302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.790642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c592-da0b-429b-9489-841cf1599302 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.790927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c592-da0b-429b-9489-841cf1599302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.791263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98c592-da0b-429b-9489-841cf1599302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.800787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c592-da0b-429b-9489-841cf1599302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.802326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98c592-da0b-429b-9489-841cf1599302 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.811797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1180/2389] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:11.838523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:11.924606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe302d8-1882-4f6b-95c4-a6b2bc261ac4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:11.930303 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:11.931011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:11.931291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:11.931551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] PATH_INFO: `/v3/users/3e7013e22c8a4c6b87c8d023ad6309af` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:11.932711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7013e22c8a4c6b87c8d023ad6309af)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:11.934665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:11.987611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7013e22c8a4c6b87c8d023ad6309af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.996032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7013e22c8a4c6b87c8d023ad6309af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.996513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7013e22c8a4c6b87c8d023ad6309af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:11.997197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7013e22c8a4c6b87c8d023ad6309af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.004733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7013e22c8a4c6b87c8d023ad6309af'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.024450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1210/2390] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:11 2022] DELETE /identity/v3/users/3e7013e22c8a4c6b87c8d023ad6309af => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:12.029197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.029482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.029905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.068564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:12.069994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:12.141219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1181/2391] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:12.151892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:12.153715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:12.215841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe97f4-2b14-47b5-9247-18fb35c0e53c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:12.219447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8f949-2a39-4969-91eb-be8fe1e766ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:12.220106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8f949-2a39-4969-91eb-be8fe1e766ba service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.220387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8f949-2a39-4969-91eb-be8fe1e766ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.220642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8f949-2a39-4969-91eb-be8fe1e766ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.232897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8f949-2a39-4969-91eb-be8fe1e766ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:12.235268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8f949-2a39-4969-91eb-be8fe1e766ba service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:12.243120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:12.251298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1211/2392] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:12.608537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:12.610038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:12.628702 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f244e-32d9-40d2-b4f2-caf8fad77c6c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:12.634177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:12.634828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.635104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.635376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] PATH_INFO: `/v3/projects/4837bfefc1154a8b91ae0220896e9173` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.637455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4837bfefc1154a8b91ae0220896e9173)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:12.639392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:12.698884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4837bfefc1154a8b91ae0220896e9173', 'request_id': 'req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.712928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4837bfefc1154a8b91ae0220896e9173', 'request_id': 'req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.723415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4837bfefc1154a8b91ae0220896e9173', 'request_id': 'req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.737567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] The token cache is being invalidate because project 4837bfefc1154a8b91ae0220896e9173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:12.738312 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.738990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-031ffa23-e3a0-4303-a8e4-3d7912ff0d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:12.740487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1182/2393] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:12 2022] DELETE /identity/v3/projects/4837bfefc1154a8b91ae0220896e9173 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:12.745614 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.746210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.746377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.767525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:12.768995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:12.828955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1212/2394] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:12.836754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.837017 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.837309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.858614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:12.859749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:12.868345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1183/2395] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:12.872821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:12.883280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0e545-e604-43a3-a81e-d4a176d8fd8d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:12.888936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:12.889546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.889821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.890082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.890726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:12.891026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:12.892601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:12.905304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1213/2396] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:12.909783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:12.921348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7c51-6103-4e96-ae84-f3c81020ea39 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:12.926449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:12.928536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:12.928844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:12.929132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:12.929778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:12.931730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:12.964353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1184/2397] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:12 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:12.968901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:12.979665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e79e0-6d0e-435c-b665-9508782699a7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:13.040499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:13.041155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:13.041436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:13.041707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:13.042340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:13.044252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:13.069709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1214/2398] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:12 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:13.071249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:13.082139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353967c-62ab-4bbc-923c-b2c8db5e2c14 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:13.087362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:13.087966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:13.088242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:13.088510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:13.089155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:13.090757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:13.100993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1185/2399] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:13.105420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:13.116042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe061a7-6f54-4d04-9812-b03d0fef6959 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:13.121218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98367d-3f3c-4e80-8b6f-fdcb6e9d7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:13.121820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98367d-3f3c-4e80-8b6f-fdcb6e9d7002 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:13.122237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98367d-3f3c-4e80-8b6f-fdcb6e9d7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:13.122496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98367d-3f3c-4e80-8b6f-fdcb6e9d7002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:13.123221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98367d-3f3c-4e80-8b6f-fdcb6e9d7002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:13.124818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98367d-3f3c-4e80-8b6f-fdcb6e9d7002 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:13.136849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1215/2400] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:13.140991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:13.151470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a753f-aa61-4ad9-816e-0d5b73240452 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:13.156414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:13.157108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:13.157385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:13.157656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] PATH_INFO: `/v3/projects/127f8353046245af953bea28e6538f80/users/072ea7557d9944358981f3bae5af0a81/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:13.173427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127f8353046245af953bea28e6538f80, user_id=072ea7557d9944358981f3bae5af0a81, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:13.176092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:13.179121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:13.193288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1186/2401] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:13 2022] PUT /identity/v3/projects/127f8353046245af953bea28e6538f80/users/072ea7557d9944358981f3bae5af0a81/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:13.203903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:13.204407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:13.204783 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:13.234553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] MFA Rules not processed for user `072ea7557d9944358981f3bae5af0a81`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:13.235872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:13.314318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:13.329317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1216/2402] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:13.349031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:13.351351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:13.415466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fa069-5a7d-4691-a607-61eec9611569 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:13.419250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad729e4-cf2b-4632-bd0a-369387b41b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:13.419871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad729e4-cf2b-4632-bd0a-369387b41b07 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:13.424745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad729e4-cf2b-4632-bd0a-369387b41b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:13.424745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad729e4-cf2b-4632-bd0a-369387b41b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:13.433427 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad729e4-cf2b-4632-bd0a-369387b41b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:13.435056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad729e4-cf2b-4632-bd0a-369387b41b07 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:13.446075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1187/2403] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:15.857924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:15.859406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:15.960492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9990-53d0-4de0-84df-affd6de7fb24 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:15.965961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:15.966577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:15.966853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:15.967121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:15.968875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:15.981224 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:15.982805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:15.993760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1217/2404] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:17.033786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:17.034291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:17.034425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:17.073173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:17.074775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:17.145271 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1188/2405] 10.222.0.65 () {58 vars in 967 bytes} [Tue Sep 13 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:17.158479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:17.159997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:17.261489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fffaeb-2491-42a3-ab18-c32f9f898c7c service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:17.267927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea0394-e634-4b47-93c5-8e8016919034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:17.269660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0394-e634-4b47-93c5-8e8016919034 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:17.270266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0394-e634-4b47-93c5-8e8016919034 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:17.270602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea0394-e634-4b47-93c5-8e8016919034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:17.292398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea0394-e634-4b47-93c5-8e8016919034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:17.294068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea0394-e634-4b47-93c5-8e8016919034 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:17.312098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1218/2406] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:04:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:17.532037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:17.533955 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:17.638207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7ee28-1e06-454b-a857-b29818c42789 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:17.644753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:17.645889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:17.646434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:17.646970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] PATH_INFO: `/v3/users/21f46edc9f8a47a08ea9e069f57d79a1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:17.648423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f46edc9f8a47a08ea9e069f57d79a1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:17.650857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:17.723101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:17.725193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f46edc9f8a47a08ea9e069f57d79a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:17.734935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f46edc9f8a47a08ea9e069f57d79a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:17.735594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f46edc9f8a47a08ea9e069f57d79a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:17.736950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f46edc9f8a47a08ea9e069f57d79a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:17.745304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f46edc9f8a47a08ea9e069f57d79a1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:17.763850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1189/2407] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:17 2022] DELETE /identity/v3/users/21f46edc9f8a47a08ea9e069f57d79a1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:17.768518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:17.768969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:17.769337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:17.788667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:17.790368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:17.852870 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1219/2408] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:17.862735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:17.864149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:17.922954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51823d6-3a3f-4ae7-a5f7-cb3b6ff5c01f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:17.926715 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a626fd-648b-4d7a-b14d-70913eeccd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:17.927324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a626fd-648b-4d7a-b14d-70913eeccd0a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:17.927600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a626fd-648b-4d7a-b14d-70913eeccd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:17.927866 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a626fd-648b-4d7a-b14d-70913eeccd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:17.937113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a626fd-648b-4d7a-b14d-70913eeccd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:17.938549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a626fd-648b-4d7a-b14d-70913eeccd0a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:17.948964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1190/2409] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:18.287624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:18.289118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:18.315621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff64bea-fe89-4dae-9ecb-cf9319716ebb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:18.322545 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:18.323399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.323845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.324450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] PATH_INFO: `/v3/projects/c94a8e80077f443bac7ccf58f2d27791` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.326320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94a8e80077f443bac7ccf58f2d27791)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:18.329183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:18.339251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:18.410593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94a8e80077f443bac7ccf58f2d27791', 'request_id': 'req-eb09e343-9b45-4d4d-b8f0-bc2d21535349'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:18.427447 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94a8e80077f443bac7ccf58f2d27791', 'request_id': 'req-eb09e343-9b45-4d4d-b8f0-bc2d21535349'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:18.443678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94a8e80077f443bac7ccf58f2d27791', 'request_id': 'req-eb09e343-9b45-4d4d-b8f0-bc2d21535349'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:18.457474 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] The token cache is being invalidate because project c94a8e80077f443bac7ccf58f2d27791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:18.457864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:18.458569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-eb09e343-9b45-4d4d-b8f0-bc2d21535349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:18.463724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1220/2410] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:18 2022] DELETE /identity/v3/projects/c94a8e80077f443bac7ccf58f2d27791 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:18.466084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.466558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.467351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.489689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:18.491706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:18.556646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1191/2411] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:18.564349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.564738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.565015 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.605647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:18.608881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:18.631836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1221/2412] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:18.649555 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:18.662004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599415ac-0241-482e-8e23-2749dd19fa3c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:18.673028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:18.673802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.674083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.674341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.674997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:18.675442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:18.677847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:18.694620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1192/2413] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:18.699311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:18.711351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1af87-4b8d-4b5b-92ed-9b3ceb74c51e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:18.731265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:18.731461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:18.732587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.733003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.733366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:18.733564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.734394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:18.737484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:18.781747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1222/2414] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:18 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:18.785317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:18.800912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022a8d5-2a0b-4fab-ace5-26249c1d2fc8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:18.806135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:18.866744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:18.867637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.867973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.868148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.870705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:18.886179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298adf1e-33f3-4b49-9233-155e7c2c3e23 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:18.891384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:18.892433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:18.901921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:18.902555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:18.902954 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:18.903082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:18.904540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:18.908886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:18.920906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1193/2415] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:18.967339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1223/2416] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:18 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:18.969277 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.007104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffe131-092f-4484-871d-83858f1eeb55 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.029537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.030337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.030709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.031102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.032231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.034025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.051156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1194/2417] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:19.052133 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.063895 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ee859-abd5-424c-b145-0c23b5938559 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.072940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875efb5-a732-4f90-a4d4-0c442119c3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.073652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875efb5-a732-4f90-a4d4-0c442119c3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.073936 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875efb5-a732-4f90-a4d4-0c442119c3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.074214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875efb5-a732-4f90-a4d4-0c442119c3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.074876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875efb5-a732-4f90-a4d4-0c442119c3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.076573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875efb5-a732-4f90-a4d4-0c442119c3f6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.090114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1224/2418] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:19.102457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.114705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93043a84-48d8-4805-9db3-350f25e6503a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.120356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.121098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.121363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.121636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] PATH_INFO: `/v3/projects/f63531eaac5d46e89dc94d622e1bf218/users/71c5e200c8fe4475aa289fad287e64ab/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.142091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63531eaac5d46e89dc94d622e1bf218, user_id=71c5e200c8fe4475aa289fad287e64ab, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.145216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.175255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1195/2419] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:19 2022] PUT /identity/v3/projects/f63531eaac5d46e89dc94d622e1bf218/users/71c5e200c8fe4475aa289fad287e64ab/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:19.176476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.176877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.177274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.214194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] MFA Rules not processed for user `71c5e200c8fe4475aa289fad287e64ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:19.215647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:19.261822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:19.313556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1225/2420] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:19.317827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.416455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d4fc1-a085-43d3-93c8-07d4dddb30c6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.425570 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.432127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.432594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.433832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.434676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.442233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.477793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1196/2421] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:19 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:19.479182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.495911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5d50-9de2-438e-ac31-ea90487cc498 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.595709 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.596319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.596633 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.596911 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.597916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.600098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.627123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1226/2422] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:19 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:19.631111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.641944 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01ac9d-8959-4286-a006-02d27cf7ddd1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.646892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.647529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.647792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.648032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.648927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.650470 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.665726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1197/2423] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:19.669752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.682157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468fa6c-fb61-48f6-9c49-3f16ed13b6ba admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.699460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2d5ca-faf2-4565-b32d-60ae03f54c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.700872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2d5ca-faf2-4565-b32d-60ae03f54c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.701552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2d5ca-faf2-4565-b32d-60ae03f54c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.702034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2d5ca-faf2-4565-b32d-60ae03f54c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.702940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2d5ca-faf2-4565-b32d-60ae03f54c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.705160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2d5ca-faf2-4565-b32d-60ae03f54c3d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.721490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1227/2424] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:19.726196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.739811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1d0a4-1e50-43af-bdca-392cffc74f81 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:19.751629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:19.752329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.752606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.752928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] PATH_INFO: `/v3/projects/68cb1e1cb9fc4499ae1adfb33961121b/users/30d1897ae2b946e9a93a1006c37e0b4d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.772568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cb1e1cb9fc4499ae1adfb33961121b, user_id=30d1897ae2b946e9a93a1006c37e0b4d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:19.775531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:19.792998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1198/2425] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:19 2022] PUT /identity/v3/projects/68cb1e1cb9fc4499ae1adfb33961121b/users/30d1897ae2b946e9a93a1006c37e0b4d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:19.806700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:19.806974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:19.807348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:19.841533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] MFA Rules not processed for user `30d1897ae2b946e9a93a1006c37e0b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:19.844182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:19.930495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1228/2426] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:19.937173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:19.975254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:20.021053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b010d-8fde-487d-8344-dea44ee47dc5 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.026493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.027324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.027606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.027872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.028529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.032235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.063173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1199/2427] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:19 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:20.068852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:20.082812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce711559-4cfe-4c63-9529-976c53bf2dce None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.138912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:20.166497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.167240 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.167531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.167799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.168486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.170623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.199013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1229/2428] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:20 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:20.203735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:20.214467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57386-1eb5-423f-9101-510ad4f2b87f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.220652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.221262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.222361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.222361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.223167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.224904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.244666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1200/2429] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:20.248332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:20.266748 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ed544-6931-4e3b-9318-5b93499b231c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.272036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.273468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.274424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.275165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] PATH_INFO: `/v3/projects/7d1a66aa0940460a993d25d3c5803f33/users/80d72ebd9de6449faef2e39ad7b489f3/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.308329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1a66aa0940460a993d25d3c5803f33, user_id=80d72ebd9de6449faef2e39ad7b489f3, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.311752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.351188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1230/2430] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:20 2022] PUT /identity/v3/projects/7d1a66aa0940460a993d25d3c5803f33/users/80d72ebd9de6449faef2e39ad7b489f3/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:20.352107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:20.363644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf3b7-a9e7-44b3-9b1c-9d68e65ccf76 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.465568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7af1c-9205-4a28-b385-081c1e5e3929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.466475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7af1c-9205-4a28-b385-081c1e5e3929 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.466939 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7af1c-9205-4a28-b385-081c1e5e3929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.467629 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7af1c-9205-4a28-b385-081c1e5e3929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.468436 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7af1c-9205-4a28-b385-081c1e5e3929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.470403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7af1c-9205-4a28-b385-081c1e5e3929 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.488401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:20.489119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1201/2431] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:20.503529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044f15c-6041-41e6-9068-5453fc320bbe admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.508838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.509607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.509955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.510268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] PATH_INFO: `/v3/projects/7d1a66aa0940460a993d25d3c5803f33/users/80d72ebd9de6449faef2e39ad7b489f3/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.512488 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1a66aa0940460a993d25d3c5803f33, user_id=80d72ebd9de6449faef2e39ad7b489f3, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.515403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.531011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1231/2432] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:20 2022] PUT /identity/v3/projects/7d1a66aa0940460a993d25d3c5803f33/users/80d72ebd9de6449faef2e39ad7b489f3/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:20.547297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.547588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.547863 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.579871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] MFA Rules not processed for user `80d72ebd9de6449faef2e39ad7b489f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:20.581195 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:20.657940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1202/2433] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:20.670636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:20.672410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:20.732739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb448dd8-15ff-432e-b35a-41eaa4227ca6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:20.736601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:20.737279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:20.737537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:20.737807 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:20.747779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:20.749410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:20.760200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1232/2434] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:21.561856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:21.571740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beca327-17ed-4c1f-b475-df8250ba4dc7 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:21.575695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:21.576511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:21.576833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:21.577382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:21.601882 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:21.646880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:21.648468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:21.657604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1203/2435] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:22.708083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:22.710179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:22.827905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea183d6-1507-4bae-afbf-33a974d44438 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:22.833408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:22.834022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:22.834295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:22.834563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:22.836307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:22.847868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:22.849684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:22.859646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1233/2436] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:23.551236 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:23.552821 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:23.613795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c095c9-5f25-40d8-9015-43cdce301b95 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:23.617538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:23.618153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:23.618426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:23.618692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:23.620488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:23.690308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:23.692031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4673096-bd9d-4a5a-999d-799ec0dc2d83 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:23.706419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1204/2437] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:24.886989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:24.893804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:24.922273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdeed7-2658-4a14-875c-3dc9efcaef7a service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:24.931009 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:24.931670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:24.932370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:24.932370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] PATH_INFO: `/v3/users/072ea7557d9944358981f3bae5af0a81` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:24.934690 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072ea7557d9944358981f3bae5af0a81)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:24.936667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:24.983984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:25.036853 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072ea7557d9944358981f3bae5af0a81'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:25.052696 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072ea7557d9944358981f3bae5af0a81'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:25.054276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072ea7557d9944358981f3bae5af0a81'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:25.055357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072ea7557d9944358981f3bae5af0a81'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:25.066309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072ea7557d9944358981f3bae5af0a81'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:25.091874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1234/2438] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:24 2022] DELETE /identity/v3/users/072ea7557d9944358981f3bae5af0a81 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:25.096668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:25.097572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:25.098098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:25.125835 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:25.127082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:25.206912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1205/2439] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:25.216326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:25.217977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:25.281698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cef26-9748-4843-b984-576f47954cd4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:25.293750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:25.296688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:25.297046 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:25.297391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:25.310037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:25.311795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:25.328200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1235/2440] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:25.893218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:25.897123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:25.920794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:25.979227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:25.993144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:25.997149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb8ad-04b2-4050-bd38-097585b9bf29 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.002176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.002819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.003094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.003364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.005206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:26.032830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de7015-a3c1-47fc-8b09-33ccbe97a5e4 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.044125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.045238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.045730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.046750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] PATH_INFO: `/v3/projects/127f8353046245af953bea28e6538f80` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.049652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127f8353046245af953bea28e6538f80)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.053876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.094688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.095862 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190ca6d-d292-44ff-b45f-68bcc73c09e3 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.106979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1206/2441] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:26.132823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127f8353046245af953bea28e6538f80', 'request_id': 'req-d900a4ea-e424-4fbc-b6b5-b8e628759876'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:26.140487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127f8353046245af953bea28e6538f80', 'request_id': 'req-d900a4ea-e424-4fbc-b6b5-b8e628759876'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:26.150063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127f8353046245af953bea28e6538f80', 'request_id': 'req-d900a4ea-e424-4fbc-b6b5-b8e628759876'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:26.164044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] The token cache is being invalidate because project 127f8353046245af953bea28e6538f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:26.164548 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:26.165535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d900a4ea-e424-4fbc-b6b5-b8e628759876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:26.172731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1236/2442] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:25 2022] DELETE /identity/v3/projects/127f8353046245af953bea28e6538f80 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:26.173621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.173914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.174188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.199392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:26.202162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:26.301114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1207/2443] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:26.307956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.308300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.308300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.335941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:26.338891 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:26.366423 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1237/2444] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:26.370898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:26.411281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e54e1-a181-47be-96ba-f624f8be0837 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.433430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.434615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.444579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.445120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.449972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:26.451804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.454040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.491771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1208/2445] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:26.492587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:26.519606 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf34e1a-e3d0-4159-9c22-5ca2467b8043 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.540252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.541749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.543430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.544391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.545787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.549238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.567860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:26.586215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1238/2446] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:26 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:26.591902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:26.605530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586584f-5113-4e7a-b71f-c551fd79ba22 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.685799 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:26.706334 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.707826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.708540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.709105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.710004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.712906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.763721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1209/2447] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:26 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:26.764499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:26.778534 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145e42c-7a68-4304-9d15-4d2c084a50c3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.786142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.786780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.787099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.788552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.790056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.793309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.808669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1239/2448] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:26.812554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:26.823212 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ad41c-de43-411e-8655-92d129833fbb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.829924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c4cf9-b143-44e6-9d76-ccc9f5a1cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.829924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c4cf9-b143-44e6-9d76-ccc9f5a1cfde admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.829924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c4cf9-b143-44e6-9d76-ccc9f5a1cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.830354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c4cf9-b143-44e6-9d76-ccc9f5a1cfde admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.830870 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c4cf9-b143-44e6-9d76-ccc9f5a1cfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.832486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c4cf9-b143-44e6-9d76-ccc9f5a1cfde admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.853337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1210/2449] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:26.854604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:26.867286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c7857-b082-4c73-8c31-1f069b99d19d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:26.877888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:26.878667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.879018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.879361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] PATH_INFO: `/v3/projects/528d5051cc744f09b93a1ee9435c8217/users/101ddc6c43ba4350bd39e062701dd744/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.905079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528d5051cc744f09b93a1ee9435c8217, user_id=101ddc6c43ba4350bd39e062701dd744, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:26.907915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:26.942851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1240/2450] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:26 2022] PUT /identity/v3/projects/528d5051cc744f09b93a1ee9435c8217/users/101ddc6c43ba4350bd39e062701dd744/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:26.943081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:26.943081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:26.943081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:26.980754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:26.985048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:27.087046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1211/2451] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:27.118036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:27.120442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:27.212718 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db107-b9a2-4669-b18d-1a4f3d3c7d24 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:27.219380 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:27.220368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:27.220772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:27.221252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:27.232898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:27.234321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:27.246179 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1241/2452] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:27.444565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:27.446787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:27.461059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183147c-26d1-4b9a-8cf8-8548cb6fedf8 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:27.467363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:27.468014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:27.468289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:27.468558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] PATH_INFO: `/v3/users/1bd4f356d39a44d7b459085e3650f6b3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:27.470049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd4f356d39a44d7b459085e3650f6b3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:27.472284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:27.528554 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd4f356d39a44d7b459085e3650f6b3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.536927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd4f356d39a44d7b459085e3650f6b3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.537558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd4f356d39a44d7b459085e3650f6b3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.538170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd4f356d39a44d7b459085e3650f6b3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.546302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd4f356d39a44d7b459085e3650f6b3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.564054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1212/2453] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:27 2022] DELETE /identity/v3/users/1bd4f356d39a44d7b459085e3650f6b3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:27.735239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:27.745683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369498d-9a6a-41e2-bdfd-f919edfe1859 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:27.822627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:27.822627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:27.822627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:27.823186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] PATH_INFO: `/v3/projects/01410cbe7e5945778267a156391df652` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:27.823921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01410cbe7e5945778267a156391df652)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:27.825947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:27.883904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01410cbe7e5945778267a156391df652', 'request_id': 'req-0a653693-42dc-4898-8da6-3008e41eee38'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.890450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01410cbe7e5945778267a156391df652', 'request_id': 'req-0a653693-42dc-4898-8da6-3008e41eee38'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.910389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01410cbe7e5945778267a156391df652', 'request_id': 'req-0a653693-42dc-4898-8da6-3008e41eee38'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.916147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:27.923900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] The token cache is being invalidate because project 01410cbe7e5945778267a156391df652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:27.924310 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.925052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:27.926885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1242/2454] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:27 2022] DELETE /identity/v3/projects/01410cbe7e5945778267a156391df652 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:27.931478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:27.933028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:27.947524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880c677-5cfe-428e-814d-6a85df50fcc2 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:28.001412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:28.018499 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:28.019411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:28.019773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:28.020094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] PATH_INFO: `/v3/users/d16d42382a084c108e5adb5c953e53a3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:28.021510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16d42382a084c108e5adb5c953e53a3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:28.024348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:28.089546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16d42382a084c108e5adb5c953e53a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.101910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16d42382a084c108e5adb5c953e53a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.102444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16d42382a084c108e5adb5c953e53a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.103049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16d42382a084c108e5adb5c953e53a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.111887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16d42382a084c108e5adb5c953e53a3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.145614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1213/2455] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:27 2022] DELETE /identity/v3/users/d16d42382a084c108e5adb5c953e53a3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:28.385662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:28.386669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:28.505264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:28.507599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:28.554112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a653693-42dc-4898-8da6-3008e41eee38 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:28.652390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde05af-b0b4-4f35-b5c9-46a22e19adcc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:28.666112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:28.667306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:28.668880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:28.670659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:28.671077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] PATH_INFO: `/v3/users/f7356d1144b14a4da1191729e2baafad` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:28.674336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:28.674496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7356d1144b14a4da1191729e2baafad)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:28.674676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:28.675037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:28.677411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:28.677545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:28.690946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:28.693268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:28.718838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1243/2456] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:28.719855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:28.722942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:28.754862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193ed36-15cc-4c42-909a-c461ce4bec11 service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:28.756088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7356d1144b14a4da1191729e2baafad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.769922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7356d1144b14a4da1191729e2baafad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.771094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7356d1144b14a4da1191729e2baafad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.771519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:28.772158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:28.772441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:28.772729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7356d1144b14a4da1191729e2baafad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.772861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] PATH_INFO: `/v3/projects/f229d693305c4c4986e1cae622cf37c9` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:28.775769 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f229d693305c4c4986e1cae622cf37c9)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:28.778762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:28.792330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7356d1144b14a4da1191729e2baafad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.794716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:28.846001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1214/2457] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:28 2022] DELETE /identity/v3/users/f7356d1144b14a4da1191729e2baafad => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:28.926494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f229d693305c4c4986e1cae622cf37c9', 'request_id': 'req-be49b2ac-f648-433e-ab43-2dd056bd8909'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.936632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f229d693305c4c4986e1cae622cf37c9', 'request_id': 'req-be49b2ac-f648-433e-ab43-2dd056bd8909'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.957163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f229d693305c4c4986e1cae622cf37c9', 'request_id': 'req-be49b2ac-f648-433e-ab43-2dd056bd8909'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.983526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] The token cache is being invalidate because project f229d693305c4c4986e1cae622cf37c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:28.984159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:28.985116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.001341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1244/2458] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:28 2022] DELETE /identity/v3/projects/f229d693305c4c4986e1cae622cf37c9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:29.006093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.008729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:29.155170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.156755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:29.169484 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995a77-6167-472b-b864-9010510a49fe admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.189194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:29.242672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.243044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.243412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.243851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] PATH_INFO: `/v3/users/71c5e200c8fe4475aa289fad287e64ab` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.245369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c5e200c8fe4475aa289fad287e64ab)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.247631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:29.318700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49b2ac-f648-433e-ab43-2dd056bd8909 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.325147 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.325974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.326394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.326754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] PATH_INFO: `/v3/projects/661fd9814f0d40af988d07eee6f89057` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.328094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661fd9814f0d40af988d07eee6f89057)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.328323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c5e200c8fe4475aa289fad287e64ab'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.330580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:29.340907 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c5e200c8fe4475aa289fad287e64ab'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.341671 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c5e200c8fe4475aa289fad287e64ab'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.343018 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c5e200c8fe4475aa289fad287e64ab'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.353899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49ab5133-269b-4900-8294-5e261ecece2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c5e200c8fe4475aa289fad287e64ab'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.384662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1215/2459] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:29 2022] DELETE /identity/v3/users/71c5e200c8fe4475aa289fad287e64ab => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:29.389873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.390455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.390899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.397376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661fd9814f0d40af988d07eee6f89057', 'request_id': 'req-afe9b051-4203-4497-9837-c31847ef88b7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.408095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661fd9814f0d40af988d07eee6f89057', 'request_id': 'req-afe9b051-4203-4497-9837-c31847ef88b7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.420496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661fd9814f0d40af988d07eee6f89057', 'request_id': 'req-afe9b051-4203-4497-9837-c31847ef88b7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.427611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:29.429379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:29.437526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:29.458007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] The token cache is being invalidate because project 661fd9814f0d40af988d07eee6f89057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:29.458563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.459701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-afe9b051-4203-4497-9837-c31847ef88b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:29.462436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1245/2460] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:29 2022] DELETE /identity/v3/projects/661fd9814f0d40af988d07eee6f89057 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:29.470070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4081cf5-0157-4150-9df5-aec6d1484aa0 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.470327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4081cf5-0157-4150-9df5-aec6d1484aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.470623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4081cf5-0157-4150-9df5-aec6d1484aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.504038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e4081cf5-0157-4150-9df5-aec6d1484aa0 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:29.505280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e4081cf5-0157-4150-9df5-aec6d1484aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:29.569616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1216/2461] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:29.582954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.585528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:29.602256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1246/2462] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:29.611268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.611551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.611823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.637475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:29.638956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:29.649467 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1247/2463] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:29.653482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.667840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f22efa-97fc-443d-b7c4-90496836e929 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.668482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe0fac-e8e6-4d3c-abdb-757aaa7c00f0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.673084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.673251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.673592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.673802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.673904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.674124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.674233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.674568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.675286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:29.675650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.677683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:29.685523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.687067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:29.696170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1248/2464] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:29.702966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.704302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1217/2465] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:29.720168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1589e9-0f07-40dd-90d4-c74b267191a4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.725030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.725662 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.725945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.726657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.727502 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.729398 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:29.760323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:29.792362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.808788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1249/2466] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:29 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:29.816503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14af99-bea5-4184-8f9e-c3cec269f06b service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.903733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.904485 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.904904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.905282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.906029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.908224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:29.953777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1218/2467] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:29 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:29.957833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:29.969157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24762ced-c7cb-431f-a4af-b54191330343 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:29.982368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:29.983060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:29.983337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:29.983617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:29.984311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:29.986136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.000134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1250/2468] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:30.004815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.015566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de638288-a8d1-4276-9072-7ee2b1dfd15a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.020289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed4acc-1649-4c90-8c32-a211fbb142ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.020946 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed4acc-1649-4c90-8c32-a211fbb142ba admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.021208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed4acc-1649-4c90-8c32-a211fbb142ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.021468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed4acc-1649-4c90-8c32-a211fbb142ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.022106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed4acc-1649-4c90-8c32-a211fbb142ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.023831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed4acc-1649-4c90-8c32-a211fbb142ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.034442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1219/2469] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:30.039291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.049883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7f649-933f-460a-832e-2c469d2d453f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.054613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.055362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.055641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.055940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] PATH_INFO: `/v3/projects/7c0d0117137848ad87b0a938a018c38e/users/374d28ed86b741cd9a276421a0a1a261/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.073051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0d0117137848ad87b0a938a018c38e, user_id=374d28ed86b741cd9a276421a0a1a261, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.075847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.093347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1251/2470] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:30 2022] PUT /identity/v3/projects/7c0d0117137848ad87b0a938a018c38e/users/374d28ed86b741cd9a276421a0a1a261/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:30.104175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.104635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.104820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.137568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] MFA Rules not processed for user `374d28ed86b741cd9a276421a0a1a261`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:30.138838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:30.159739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:30.213418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1220/2471] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:30.217965 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.284990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc43960-873c-4fa8-b94e-7207f836f07d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.291110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.292381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.292381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.292686 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.293428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.295552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.328806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1252/2472] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:30 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:30.331588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.343713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1e86-c9c3-4fa2-82c8-9d2b7f515b6a None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.425920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.427144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.427921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.431391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.432138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.434406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.476219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1221/2473] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:30 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:30.480409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.510367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c583e06-86d9-40fe-a25c-904405d0f359 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.516410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.517732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.518202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.518752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.519711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.525844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.526058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.528305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:30.543194 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1253/2474] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:30.547390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.551938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c09a5-be81-46de-9c5e-b5a90fcbf821 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.559101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fd9ce-a0a7-4f7c-a9ce-01a1e9b7fd62 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.563700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.564773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.565809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.566282 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.567001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] PATH_INFO: `/v3/projects/69f1688ea96643848bd1e3264eb416ef/users/fd25ea3aa90f4080a60dc922e4f4a9ad/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.569080 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.569622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.570113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] PATH_INFO: `/v3/projects/f63531eaac5d46e89dc94d622e1bf218` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.571908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63531eaac5d46e89dc94d622e1bf218)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.574088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.589379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f1688ea96643848bd1e3264eb416ef, user_id=fd25ea3aa90f4080a60dc922e4f4a9ad, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.595195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.620141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1254/2475] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:30 2022] PUT /identity/v3/projects/69f1688ea96643848bd1e3264eb416ef/users/fd25ea3aa90f4080a60dc922e4f4a9ad/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:30.624510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.669482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63531eaac5d46e89dc94d622e1bf218', 'request_id': 'req-20dd5d42-6b30-4071-b725-6ab224e79dcf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.679808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63531eaac5d46e89dc94d622e1bf218', 'request_id': 'req-20dd5d42-6b30-4071-b725-6ab224e79dcf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.709652 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63531eaac5d46e89dc94d622e1bf218', 'request_id': 'req-20dd5d42-6b30-4071-b725-6ab224e79dcf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.709873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca70a-af99-4ce9-8969-b89e4a64f211 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.725406 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] The token cache is being invalidate because project f63531eaac5d46e89dc94d622e1bf218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:30.725693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.727467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.729935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1222/2476] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:30 2022] DELETE /identity/v3/projects/f63531eaac5d46e89dc94d622e1bf218 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:30.733664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.735061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:30.737482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:30.798359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:30.800200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.801124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.801627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.802163 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.803800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.805475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.825384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1255/2477] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:30.829409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.831511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:30.843239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd5d42-6b30-4071-b725-6ab224e79dcf admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.846061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e934b-2c30-44c6-8224-d37aa44e5165 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.849414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.850170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.850546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.850985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] PATH_INFO: `/v3/users/30d1897ae2b946e9a93a1006c37e0b4d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.851658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d5ce-d4c6-426b-8f91-b288c016963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.852107 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d5ce-d4c6-426b-8f91-b288c016963e admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.852388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d5ce-d4c6-426b-8f91-b288c016963e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.852569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d1897ae2b946e9a93a1006c37e0b4d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.852704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d5ce-d4c6-426b-8f91-b288c016963e admin admin] PATH_INFO: `/v3/projects/69f1688ea96643848bd1e3264eb416ef/users/fd25ea3aa90f4080a60dc922e4f4a9ad/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.854811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.859566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d5ce-d4c6-426b-8f91-b288c016963e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f1688ea96643848bd1e3264eb416ef, user_id=fd25ea3aa90f4080a60dc922e4f4a9ad, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.863492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d5ce-d4c6-426b-8f91-b288c016963e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:30.884327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1256/2478] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:30 2022] PUT /identity/v3/projects/69f1688ea96643848bd1e3264eb416ef/users/fd25ea3aa90f4080a60dc922e4f4a9ad/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:30.896497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.896979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.897808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.933094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d1897ae2b946e9a93a1006c37e0b4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.944218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d1897ae2b946e9a93a1006c37e0b4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.946022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d1897ae2b946e9a93a1006c37e0b4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.947223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d1897ae2b946e9a93a1006c37e0b4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.952546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] MFA Rules not processed for user `fd25ea3aa90f4080a60dc922e4f4a9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:30.953500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:30.961147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d1897ae2b946e9a93a1006c37e0b4d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:30.995103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1223/2479] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:30 2022] DELETE /identity/v3/users/30d1897ae2b946e9a93a1006c37e0b4d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:31.046326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1257/2480] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:31.053222 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:31.054969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:31.164418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9fa9-ff5c-48ed-8f54-1d8181e074b4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:31.170616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:31.170616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:31.170616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:31.171021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:31.265057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:31.266632 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:31.282718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1224/2481] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:31.589230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:31.593790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:31.733159 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef938ec-81ca-4403-910b-da5dd6c58b40 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:31.775876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:31.817066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:31.817856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:31.818344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:31.818711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] PATH_INFO: `/v3/projects/68cb1e1cb9fc4499ae1adfb33961121b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:31.820887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68cb1e1cb9fc4499ae1adfb33961121b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:31.823300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:31.901077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68cb1e1cb9fc4499ae1adfb33961121b', 'request_id': 'req-c1e05e59-670c-463f-97e6-c977b0d85a13'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.909815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68cb1e1cb9fc4499ae1adfb33961121b', 'request_id': 'req-c1e05e59-670c-463f-97e6-c977b0d85a13'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.922101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68cb1e1cb9fc4499ae1adfb33961121b', 'request_id': 'req-c1e05e59-670c-463f-97e6-c977b0d85a13'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.940233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] The token cache is being invalidate because project 68cb1e1cb9fc4499ae1adfb33961121b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:31.940654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.947627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.949629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1258/2482] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:31 2022] DELETE /identity/v3/projects/68cb1e1cb9fc4499ae1adfb33961121b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:31.953623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:31.960172 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:31.968201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1e880-4dec-4f7d-9cda-0098c01aa3b0 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.051463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.052588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.052588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.052814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] PATH_INFO: `/v3/users/80d72ebd9de6449faef2e39ad7b489f3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.054025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d72ebd9de6449faef2e39ad7b489f3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.056087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.139381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d72ebd9de6449faef2e39ad7b489f3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.151095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d72ebd9de6449faef2e39ad7b489f3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.153000 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d72ebd9de6449faef2e39ad7b489f3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.154425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d72ebd9de6449faef2e39ad7b489f3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.168581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b5723afa-6080-4e15-bc5b-089e91df57f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d72ebd9de6449faef2e39ad7b489f3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.201704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1225/2483] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:31 2022] DELETE /identity/v3/users/80d72ebd9de6449faef2e39ad7b489f3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:32.855373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.860148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:32.879137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05e59-670c-463f-97e6-c977b0d85a13 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.976637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.977392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.977623 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.977897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] PATH_INFO: `/v3/projects/7d1a66aa0940460a993d25d3c5803f33` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.979045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1a66aa0940460a993d25d3c5803f33)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.980982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.078113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1a66aa0940460a993d25d3c5803f33', 'request_id': 'req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.085678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1a66aa0940460a993d25d3c5803f33', 'request_id': 'req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.103253 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1a66aa0940460a993d25d3c5803f33', 'request_id': 'req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.112974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:33.123663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] The token cache is being invalidate because project 7d1a66aa0940460a993d25d3c5803f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:33.124306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.125905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d41ac1aa-3fc3-4d79-9692-d540cbbc74e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.128588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1259/2484] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:32 2022] DELETE /identity/v3/projects/7d1a66aa0940460a993d25d3c5803f33 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:33.134878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.135441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.135441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.164941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:33.167005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.217478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2af9-185f-4f9e-a928-c65813ec208b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.217763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2af9-185f-4f9e-a928-c65813ec208b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.218063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e2af9-185f-4f9e-a928-c65813ec208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.256026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-a89e2af9-185f-4f9e-a928-c65813ec208b None None] MFA Rules not processed for user `101ddc6c43ba4350bd39e062701dd744`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:33.257438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a89e2af9-185f-4f9e-a928-c65813ec208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.286295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1226/2485] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:33.287383 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.291029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.326363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020963a-c8a8-4e47-8397-6ae63a3eb668 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.332357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.333099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.333451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.333707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] PATH_INFO: `/v3/users/374d28ed86b741cd9a276421a0a1a261` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.334767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=374d28ed86b741cd9a276421a0a1a261)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.336773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.355540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:33.384193 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1260/2486] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:33.388010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.388511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.388953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.396053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374d28ed86b741cd9a276421a0a1a261'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.405214 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374d28ed86b741cd9a276421a0a1a261'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.406776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374d28ed86b741cd9a276421a0a1a261'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.407407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374d28ed86b741cd9a276421a0a1a261'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.410683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:33.412508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.415471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374d28ed86b741cd9a276421a0a1a261'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:33.424811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1261/2487] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:33.424811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.425083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.440241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f80469-6b20-4217-b9ae-06cfabd3fce4 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.446061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6159ca7b-8a5b-4b6b-af56-372885fea18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.446245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ca7b-8a5b-4b6b-af56-372885fea18c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.446525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ca7b-8a5b-4b6b-af56-372885fea18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.446799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159ca7b-8a5b-4b6b-af56-372885fea18c admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.447448 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ca7b-8a5b-4b6b-af56-372885fea18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.449473 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6159ca7b-8a5b-4b6b-af56-372885fea18c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.453036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1227/2488] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:33 2022] DELETE /identity/v3/users/374d28ed86b741cd9a276421a0a1a261 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:33.457178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.483008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1262/2489] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:33.484365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.484745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.485025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.508034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:33.509715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.527228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83babe8f-aa8a-4b94-878c-d7ec6399dd2c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.575422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1263/2490] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:33.576245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.591002 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe006-95d7-4234-be39-7899d31dde36 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.596003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.596658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.596933 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.597202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.597844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.599787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.600886 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.601896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.602465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.603039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.603904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:33.604322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.606264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.623300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1228/2491] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:33.623300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.628724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1264/2492] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/users => generated 299 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:33.631378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.634495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.648561 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee14bd-4ef1-49f7-86e4-79f785d73905 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.654246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.654872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.655152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.655421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.656058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.658011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.681813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:33.688857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1265/2493] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:33.690402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.706025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43dd88-08ac-4962-9a2e-472d0a8122bb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.719975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:33.763863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62455fba-2eff-436d-a733-61711b620fe1 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.766837 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.767454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.767753 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.767985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.769481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.770104 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.770385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.770670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.771439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.774907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.779923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.780532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.805156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1229/2494] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:33.806320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.813831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1266/2495] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:33.816676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef704bf5-0361-4d10-8393-e3d45bed11a5 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.818233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.822527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.823491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.823491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.823924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.824726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.826781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.829609 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188ecb7-0470-43f0-b776-1f173bf30e6d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.834578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.835244 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.835524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.835799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] PATH_INFO: `/v3/projects/12ec26d74c2f4c68808499f0633feeb9/users/9a848ff25e704e1f8fa1a01f9e627d6a/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.859986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1230/2496] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:33.864070 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ec26d74c2f4c68808499f0633feeb9, user_id=9a848ff25e704e1f8fa1a01f9e627d6a, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.867659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.868962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.882578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828716-b1b7-4465-a6ad-cf8c8eb3f37d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.892550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1267/2497] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:33 2022] PUT /identity/v3/projects/12ec26d74c2f4c68808499f0633feeb9/users/9a848ff25e704e1f8fa1a01f9e627d6a/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:33.893667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.970525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.971777 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.972066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.972340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.973160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.975998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.988809 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1231/2498] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:33.989227 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c488b-0b14-46fe-b906-9ae0cd17446c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.992811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.996379 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.997119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.997454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.997903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.998596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.000862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.005884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309ec39-37b6-467e-8c20-3beb87e4652b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.013183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.014756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.015128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.015592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.016306 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.018095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.027860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1268/2499] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:34.032420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.033483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1232/2500] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:34.037739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.048922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df3ed-7510-44c1-a2b2-35016f239950 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.051091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949da5f-f6cb-45a2-a14b-8f4c77a12c05 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.055434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293bea2-6cc9-432d-84c5-9db32d01b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.056167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293bea2-6cc9-432d-84c5-9db32d01b862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.056474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.056642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293bea2-6cc9-432d-84c5-9db32d01b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.057012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293bea2-6cc9-432d-84c5-9db32d01b862 admin admin] PATH_INFO: `/v3/projects/12ec26d74c2f4c68808499f0633feeb9/users/9a848ff25e704e1f8fa1a01f9e627d6a/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.057175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.057455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.057976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] PATH_INFO: `/v3/projects/c5a6b26846a24b72858e58bf1955c7f1/users/f92084870bce41a2b35bf6a25512775d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.059388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293bea2-6cc9-432d-84c5-9db32d01b862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ec26d74c2f4c68808499f0633feeb9, user_id=9a848ff25e704e1f8fa1a01f9e627d6a, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.062427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293bea2-6cc9-432d-84c5-9db32d01b862 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.075732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a6b26846a24b72858e58bf1955c7f1, user_id=f92084870bce41a2b35bf6a25512775d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.078688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.079861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1269/2501] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:34 2022] PUT /identity/v3/projects/12ec26d74c2f4c68808499f0633feeb9/users/9a848ff25e704e1f8fa1a01f9e627d6a/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:34.098746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1233/2502] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:34 2022] PUT /identity/v3/projects/c5a6b26846a24b72858e58bf1955c7f1/users/f92084870bce41a2b35bf6a25512775d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:34.110801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.111093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.111367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.156808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] MFA Rules not processed for user `f92084870bce41a2b35bf6a25512775d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:34.158186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:34.161712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.163650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:34.216099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:34.265989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5916e9-0b97-4602-a4a9-fb4364ee69fc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.273903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.274564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.274843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.275120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] PATH_INFO: `/v3/projects/7c0d0117137848ad87b0a938a018c38e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.276683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0d0117137848ad87b0a938a018c38e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.280529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.282288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1270/2503] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:34.288191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.297322 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:34.313698 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51091805-a7e4-4267-8802-5557a9225a42 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.321905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.322525 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.322977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.323331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.323926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.326715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.352550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0d0117137848ad87b0a938a018c38e', 'request_id': 'req-ff67a062-0f82-4699-af7d-2b69cfb6b83a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.359924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0d0117137848ad87b0a938a018c38e', 'request_id': 'req-ff67a062-0f82-4699-af7d-2b69cfb6b83a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.368366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1271/2504] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:34 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:34.374268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.376600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0d0117137848ad87b0a938a018c38e', 'request_id': 'req-ff67a062-0f82-4699-af7d-2b69cfb6b83a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.399369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] The token cache is being invalidate because project 7c0d0117137848ad87b0a938a018c38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:34.399648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.400538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.403502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1234/2505] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:34 2022] DELETE /identity/v3/projects/7c0d0117137848ad87b0a938a018c38e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:34.407974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.409636 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:34.464484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f3774-79b0-447e-8dcd-75011607879b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.470499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.471248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.471644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.472136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.473153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.475258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.513112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1272/2506] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:34 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:34.517435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.522181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:34.540363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a17b4-de02-4fc1-89a9-946707daec40 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.545833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.547232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.547613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.548837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.549840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.554355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.564067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67a062-0f82-4699-af7d-2b69cfb6b83a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.570340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.571447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.571890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.572502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] PATH_INFO: `/v3/users/fd25ea3aa90f4080a60dc922e4f4a9ad` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.573735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1273/2507] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:34.574347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd25ea3aa90f4080a60dc922e4f4a9ad)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.576759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.579339 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.602049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b0a3b-7917-4df6-bc06-e0de70cb5f56 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.633160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.633889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.634188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.634491 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] PATH_INFO: `/v3/projects/3e6017f75b774871aae2e45f831bc568/users/b67dcce272694f89b8d4fa0e3a7ed8cf/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.669099 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd25ea3aa90f4080a60dc922e4f4a9ad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.671481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6017f75b774871aae2e45f831bc568, user_id=b67dcce272694f89b8d4fa0e3a7ed8cf, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.678222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.682980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd25ea3aa90f4080a60dc922e4f4a9ad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.685032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd25ea3aa90f4080a60dc922e4f4a9ad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.686091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd25ea3aa90f4080a60dc922e4f4a9ad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.703556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd25ea3aa90f4080a60dc922e4f4a9ad'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:34.704974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1274/2508] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:34 2022] PUT /identity/v3/projects/3e6017f75b774871aae2e45f831bc568/users/b67dcce272694f89b8d4fa0e3a7ed8cf/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:34.710286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.712654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:34.722977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:34.745103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1235/2509] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:34 2022] DELETE /identity/v3/users/fd25ea3aa90f4080a60dc922e4f4a9ad => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:34.804711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3868f1-ba9c-4f83-8c36-810bd45ee7ff admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.879407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:34.914494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f517f3a-f237-4db5-86ad-1aa01c1d564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.915966 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f517f3a-f237-4db5-86ad-1aa01c1d564e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.916414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f517f3a-f237-4db5-86ad-1aa01c1d564e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.916725 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f517f3a-f237-4db5-86ad-1aa01c1d564e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.918086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f517f3a-f237-4db5-86ad-1aa01c1d564e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.922752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f517f3a-f237-4db5-86ad-1aa01c1d564e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.938541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1275/2510] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:34.944386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:34.957635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f30d4a-a71f-4c26-9000-b40188b5a171 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:34.962676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:34.963352 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.963754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.964090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] PATH_INFO: `/v3/projects/3e6017f75b774871aae2e45f831bc568/users/b67dcce272694f89b8d4fa0e3a7ed8cf/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:34.966077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6017f75b774871aae2e45f831bc568, user_id=b67dcce272694f89b8d4fa0e3a7ed8cf, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:34.968947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:34.982811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1236/2511] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:34 2022] PUT /identity/v3/projects/3e6017f75b774871aae2e45f831bc568/users/b67dcce272694f89b8d4fa0e3a7ed8cf/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:34.994209 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:34.994751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:34.995673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.035938 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] MFA Rules not processed for user `b67dcce272694f89b8d4fa0e3a7ed8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:35.057069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.105437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.107175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.160879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1276/2512] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:35.178328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.180642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.231281 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b223-6aaf-4924-aaae-068c7e46b065 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.237086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.237893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.238235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.238691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] PATH_INFO: `/v3/projects/69f1688ea96643848bd1e3264eb416ef` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.240464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f1688ea96643848bd1e3264eb416ef)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.243646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.279482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3151da-41da-4d18-83e3-607481013bdd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.285568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b96cf-e23b-4572-a3ef-eda3425a1a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.286543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b96cf-e23b-4572-a3ef-eda3425a1a2b service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.286979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b96cf-e23b-4572-a3ef-eda3425a1a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.287432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b96cf-e23b-4572-a3ef-eda3425a1a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.300187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b96cf-e23b-4572-a3ef-eda3425a1a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.303252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b96cf-e23b-4572-a3ef-eda3425a1a2b service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.321245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1277/2513] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:35.338843 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f1688ea96643848bd1e3264eb416ef', 'request_id': 'req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:35.347303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f1688ea96643848bd1e3264eb416ef', 'request_id': 'req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:35.358020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f1688ea96643848bd1e3264eb416ef', 'request_id': 'req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:35.386560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] The token cache is being invalidate because project 69f1688ea96643848bd1e3264eb416ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:35.386560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:35.387847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:35.391326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1237/2514] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:35 2022] DELETE /identity/v3/projects/69f1688ea96643848bd1e3264eb416ef => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:35.396663 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153605-570f-4090-9a22-0afe1b4c8027 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.397215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153605-570f-4090-9a22-0afe1b4c8027 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.397816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153605-570f-4090-9a22-0afe1b4c8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.438120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ed153605-570f-4090-9a22-0afe1b4c8027 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:35.449094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.452102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.452859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ed153605-570f-4090-9a22-0afe1b4c8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.530859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1278/2515] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:35.539212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.539744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.540888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.557360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a7ff7-0f45-46a9-96e2-9eb26e4afb61 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.561927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.562656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:35.562921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.563205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.564304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.566428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.571899 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:35.573673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:35.583789 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1279/2516] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:35.589408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.600076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:35.611174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de989ec2-48ca-48d3-9d51-5487c94a48e9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.617420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.620228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.620712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.621141 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.622504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:35.623173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.625114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.644135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1280/2517] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:35.650135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.660076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.661947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.668788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bae6f-022a-401a-a103-919379943302 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.674525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1238/2518] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:35.676979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.677615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.677932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.678212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.678846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.682245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.729181 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1281/2519] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:35 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:35.733653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.745490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f1141-8f8e-4807-a249-16c70cc9a1d9 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.854063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.854846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.855167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.855443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.860280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.861020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.914402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.923601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1239/2520] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:35 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:35.932362 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a21b1f-8ce8-4960-ae86-6ed261cbed30 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.940672 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.941512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.941863 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.942404 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.943143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.946315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:35.965586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:35.974114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1282/2521] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:35.978980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a524be-8946-4da4-94b0-c37396658968 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:35.985459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:35.986256 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:35.986627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:35.987026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:35.987790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:35.989936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.007206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1240/2522] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:36.008168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.021377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51aec61-7400-466a-89d1-d85163d953f5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.027970 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc026ac-6953-475d-a3e0-94541f00c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.028695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc026ac-6953-475d-a3e0-94541f00c882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.028974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc026ac-6953-475d-a3e0-94541f00c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.029247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc026ac-6953-475d-a3e0-94541f00c882 admin admin] PATH_INFO: `/v3/projects/a3aafa644b714a2cb126cb72a174e486/users/9f51713ae75548c7a64efa53ed18c414/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.059234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc026ac-6953-475d-a3e0-94541f00c882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3aafa644b714a2cb126cb72a174e486, user_id=9f51713ae75548c7a64efa53ed18c414, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.067157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc026ac-6953-475d-a3e0-94541f00c882 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.097042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1283/2523] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:36 2022] PUT /identity/v3/projects/a3aafa644b714a2cb126cb72a174e486/users/9f51713ae75548c7a64efa53ed18c414/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:36.101508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.107079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:36.108774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.110601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.111256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.122639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f609ef-dcd7-4477-beff-027d9aa56ec9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.165979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] MFA Rules not processed for user `9f51713ae75548c7a64efa53ed18c414`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:36.167657 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:36.216323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.217342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.217819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.218681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] PATH_INFO: `/v3/users/f92084870bce41a2b35bf6a25512775d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.223545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92084870bce41a2b35bf6a25512775d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.230949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.296101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:36.309998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92084870bce41a2b35bf6a25512775d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:36.318538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1284/2524] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:36.323645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.333525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92084870bce41a2b35bf6a25512775d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:36.334252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92084870bce41a2b35bf6a25512775d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:36.334963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92084870bce41a2b35bf6a25512775d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:36.341300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5dd727-2eba-430c-92d5-5e485e179774 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.347774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.348679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.349040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.349386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.350132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.352442 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-d40e2501-6c41-42ac-aa9e-f701b1abcec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92084870bce41a2b35bf6a25512775d'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:36.352597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.383704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1241/2525] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:36 2022] DELETE /identity/v3/users/f92084870bce41a2b35bf6a25512775d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:36.392977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.393140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.393513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.424485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1285/2526] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:36 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:36.426884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.429441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:36.448768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:36.450971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:36.552672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1242/2527] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:36.552882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:36.561396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.563007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:36.572735 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51d8e-e983-4c93-b3b1-1b05d22236e7 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.579142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.579868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.580035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.580309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.582328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.584357 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.636458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1286/2528] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:36 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:36.638430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.656496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedfa95-2bea-4fe6-9acc-91563eb73b1a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.664522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.665246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.665521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.665806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.666555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.669576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.670403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d2056-621e-4e16-884e-9a691e85d841 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.676142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.676817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.677094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.677364 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.683692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1287/2529] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:36.684892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.688135 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.689941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.696320 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8fbf6-6105-4260-b173-402869af5feb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.701942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1243/2530] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:36.710632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.711462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.716768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.717144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] PATH_INFO: `/v3/projects/080120fabef9406d85e232ca9c4cd3c8/users/14b7d9bfbd734653963a9a689b5ab6f2/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.739648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=080120fabef9406d85e232ca9c4cd3c8, user_id=14b7d9bfbd734653963a9a689b5ab6f2, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.744174 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.773973 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1288/2531] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:36 2022] PUT /identity/v3/projects/080120fabef9406d85e232ca9c4cd3c8/users/14b7d9bfbd734653963a9a689b5ab6f2/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:36.778371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.791295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ecc3-9d47-4fd3-9cf1-496181881e3e service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.919709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564a7bb-4de4-4c89-b0ea-d119c06a93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.920336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564a7bb-4de4-4c89-b0ea-d119c06a93a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.920638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564a7bb-4de4-4c89-b0ea-d119c06a93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.920988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564a7bb-4de4-4c89-b0ea-d119c06a93a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.921532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564a7bb-4de4-4c89-b0ea-d119c06a93a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.923713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564a7bb-4de4-4c89-b0ea-d119c06a93a3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:36.924878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:36.940586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1244/2532] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:36.945705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:36.969632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0efe-d299-4097-84db-8d2e9cce23cc admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:36.980927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:36.981627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.981906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.982175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] PATH_INFO: `/v3/projects/080120fabef9406d85e232ca9c4cd3c8/users/14b7d9bfbd734653963a9a689b5ab6f2/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.993532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080120fabef9406d85e232ca9c4cd3c8, user_id=14b7d9bfbd734653963a9a689b5ab6f2, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:36.996204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:37.022648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1289/2533] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:36 2022] PUT /identity/v3/projects/080120fabef9406d85e232ca9c4cd3c8/users/14b7d9bfbd734653963a9a689b5ab6f2/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:37.034328 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:37.034752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:37.035142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:37.082032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] MFA Rules not processed for user `14b7d9bfbd734653963a9a689b5ab6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:37.083428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:37.182044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1245/2534] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:37.194774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:37.197504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:37.287513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1ec58-9b88-47f1-b5d3-7e1bbd2a6c53 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:37.292371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:37.293287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:37.293661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:37.294308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:37.296197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:37.386675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:37.388151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:37.409243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1290/2535] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:37.528675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:37.530477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:37.670533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d346a2-6c5a-44ff-8935-1c3e73cacb84 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:37.680449 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:37.681154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:37.681615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:37.681940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] PATH_INFO: `/v3/projects/c5a6b26846a24b72858e58bf1955c7f1` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:37.683846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a6b26846a24b72858e58bf1955c7f1)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:37.686074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:37.780970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a6b26846a24b72858e58bf1955c7f1', 'request_id': 'req-7f261299-3832-465c-bf44-a7fd06eb265a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:37.793752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a6b26846a24b72858e58bf1955c7f1', 'request_id': 'req-7f261299-3832-465c-bf44-a7fd06eb265a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:37.825178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a6b26846a24b72858e58bf1955c7f1', 'request_id': 'req-7f261299-3832-465c-bf44-a7fd06eb265a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:37.855528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] The token cache is being invalidate because project c5a6b26846a24b72858e58bf1955c7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:37.855878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:37.860732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:37.866467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1246/2536] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:37 2022] DELETE /identity/v3/projects/c5a6b26846a24b72858e58bf1955c7f1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:37.870920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:37.890964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fdec4-bd91-44b4-89c0-c62454de7118 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:38.011885 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:38.040084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:38.040834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:38.041113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:38.041435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] PATH_INFO: `/v3/users/b67dcce272694f89b8d4fa0e3a7ed8cf` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:38.042666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67dcce272694f89b8d4fa0e3a7ed8cf)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:38.044736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:38.136687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67dcce272694f89b8d4fa0e3a7ed8cf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.153795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67dcce272694f89b8d4fa0e3a7ed8cf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.154934 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67dcce272694f89b8d4fa0e3a7ed8cf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.155601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67dcce272694f89b8d4fa0e3a7ed8cf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.165259 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-a19e90d2-465a-4ece-9e13-6cd6e1b59e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67dcce272694f89b8d4fa0e3a7ed8cf'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.190041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1291/2537] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:37 2022] DELETE /identity/v3/users/b67dcce272694f89b8d4fa0e3a7ed8cf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:38.672197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:38.674510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:38.708534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261299-3832-465c-bf44-a7fd06eb265a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:38.735924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:38.821479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:38.822120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:38.822428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:38.822954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] PATH_INFO: `/v3/projects/3e6017f75b774871aae2e45f831bc568` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:38.824417 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6017f75b774871aae2e45f831bc568)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:38.826372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:38.911782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6017f75b774871aae2e45f831bc568', 'request_id': 'req-25220c36-82d1-4500-8957-1d498783af02'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.920871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6017f75b774871aae2e45f831bc568', 'request_id': 'req-25220c36-82d1-4500-8957-1d498783af02'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.933521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6017f75b774871aae2e45f831bc568', 'request_id': 'req-25220c36-82d1-4500-8957-1d498783af02'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.948102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] The token cache is being invalidate because project 3e6017f75b774871aae2e45f831bc568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:38.948102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.949662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-25220c36-82d1-4500-8957-1d498783af02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:38.953858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1247/2538] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:38 2022] DELETE /identity/v3/projects/3e6017f75b774871aae2e45f831bc568 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:38.960246 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:38.960527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:38.960832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:38.997599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:39.000001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:39.103512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1292/2539] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:39.114419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7478-1227-4443-bd98-129de967aad1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.114850 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7478-1227-4443-bd98-129de967aad1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.115225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b7478-1227-4443-bd98-129de967aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.144645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-237b7478-1227-4443-bd98-129de967aad1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:39.145913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-237b7478-1227-4443-bd98-129de967aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:39.155714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1248/2540] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:39.161435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.175417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7a85-1c13-4c36-ac04-af40bc4b76a1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.182669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.182967 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.183297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.183665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.184489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:39.184945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.186777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.204800 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1293/2541] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:39.208004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7478-1227-4443-bd98-129de967aad1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.220044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b7478-1227-4443-bd98-129de967aad1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.226736 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.227773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.228319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.228876 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.229705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.232007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.281240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1249/2542] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:39 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:39.286062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.298935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ebf6e-6a92-4e02-a1a0-8781f98e80f5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.389734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.390482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.390835 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.391178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.392028 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.394023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.404882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:39.448728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1294/2543] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:39 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:39.449993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.462467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2835ddf-bc85-4bd0-ac1d-4e11e7ff2e17 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.471338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.471994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.472396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.472701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.473422 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.475206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.487552 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1250/2544] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:39.493427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.506674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8681b-63b8-4d0a-8aab-24b9ccc53aaa admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.513647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45b8fa-58ed-4c52-8f43-11c68bf086da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.515167 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45b8fa-58ed-4c52-8f43-11c68bf086da admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.515523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45b8fa-58ed-4c52-8f43-11c68bf086da admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.515866 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45b8fa-58ed-4c52-8f43-11c68bf086da admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.516587 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45b8fa-58ed-4c52-8f43-11c68bf086da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.518326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45b8fa-58ed-4c52-8f43-11c68bf086da admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.530143 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1295/2545] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:39.534258 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.545349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64e984-480b-4493-a703-d31dd21a2242 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.550143 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.550965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.551311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.551656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] PATH_INFO: `/v3/projects/6a6060bd67584d1c8a35264482556727/users/93b7a979cff8457089aab3f383715e19/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.569911 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6060bd67584d1c8a35264482556727, user_id=93b7a979cff8457089aab3f383715e19, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.573375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.591165 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1251/2546] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:39 2022] PUT /identity/v3/projects/6a6060bd67584d1c8a35264482556727/users/93b7a979cff8457089aab3f383715e19/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:39.601547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144ce9-a85d-4062-9582-f69d4d199112 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.601878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144ce9-a85d-4062-9582-f69d4d199112 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.602155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144ce9-a85d-4062-9582-f69d4d199112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.634828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1e144ce9-a85d-4062-9582-f69d4d199112 None None] MFA Rules not processed for user `93b7a979cff8457089aab3f383715e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:39.636581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1e144ce9-a85d-4062-9582-f69d4d199112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:39.726916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1296/2547] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:39.735392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.737716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:39.787315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:39.811768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b448bc-e4a0-42f4-a8bd-98a9f10c7bfb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.825865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.826663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.827036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.827401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.840526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.843906 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.857407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1252/2548] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:40.081522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.081815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.082088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.138737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] MFA Rules not processed for user `9a848ff25e704e1f8fa1a01f9e627d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:40.140408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.229946 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1297/2549] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:40.245336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.246940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.263318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d293346-95cd-46e4-b8b3-a673dc64b3e2 service glance] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:40.267497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:40.268187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.268467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.268786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.270577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.340330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:40.343845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f7dc0-9fe7-43ee-9851-9020c0bc9388 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:40.362625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1253/2550] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:40.392776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.402506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.528258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa9ea4-acc3-4c4e-9a23-67bbb629a1db None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:40.533832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:40.535394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.535931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.537001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.539771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.549660 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:40.555874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041c3af-bd6d-4139-a496-67390b3a94ce None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.556260 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041c3af-bd6d-4139-a496-67390b3a94ce None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.556772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041c3af-bd6d-4139-a496-67390b3a94ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.583905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5041c3af-bd6d-4139-a496-67390b3a94ce None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:40.585197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5041c3af-bd6d-4139-a496-67390b3a94ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.641985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:40.643902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:40.657006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1298/2551] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:40.675187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1254/2552] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:40.686077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.689706 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.821203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67284c-2869-42cb-ac03-98966920acc6 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:40.830230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:40.831089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.831532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.831993 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.842512 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:40.844273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:40.862305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1299/2553] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:04:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:50.320732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834c72e-29a8-4c49-ab3b-a659c51074a2 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:50.321361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834c72e-29a8-4c49-ab3b-a659c51074a2 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:50.321361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834c72e-29a8-4c49-ab3b-a659c51074a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:50.341323 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7834c72e-29a8-4c49-ab3b-a659c51074a2 None None] MFA Rules not processed for user `101ddc6c43ba4350bd39e062701dd744`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:50.342527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7834c72e-29a8-4c49-ab3b-a659c51074a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:50.349614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1255/2554] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:50.614752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:50.616325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:50.677711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08d37-d72c-4987-9b52-6d175a744999 service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:50.681947 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:50.682553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:50.682806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:50.683074 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:50.685722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:50.697372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:50.698806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:50.707052 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1300/2555] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:53.729488 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:53.730280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:53.730718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:53.750341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:53.751919 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:53.759085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1256/2556] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:04:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:53.771703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:53.784158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb7e7-60a6-4b76-8759-e37ff43cbeb9 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:53.790215 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5e2f8-c2d2-420f-8bbd-c9a57a6d61ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:53.790832 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5e2f8-c2d2-420f-8bbd-c9a57a6d61ed service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:53.791114 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5e2f8-c2d2-420f-8bbd-c9a57a6d61ed service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:53.791389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5e2f8-c2d2-420f-8bbd-c9a57a6d61ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:53.800136 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5e2f8-c2d2-420f-8bbd-c9a57a6d61ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:53.801810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5e2f8-c2d2-420f-8bbd-c9a57a6d61ed service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:53.810252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1301/2557] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:04:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:54.052688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:54.055496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:54.169382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de678bc9-2168-4b78-ac7a-52980b5d319c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:54.175831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:54.178461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:54.178737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:54.179005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] PATH_INFO: `/v3/users/9f51713ae75548c7a64efa53ed18c414` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:54.182530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f51713ae75548c7a64efa53ed18c414)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:54.187235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:54.206616 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:54.263275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f51713ae75548c7a64efa53ed18c414'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:54.295324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f51713ae75548c7a64efa53ed18c414'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:54.295951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f51713ae75548c7a64efa53ed18c414'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:54.296566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f51713ae75548c7a64efa53ed18c414'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:54.322325 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f51713ae75548c7a64efa53ed18c414'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:54.353844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1257/2558] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:54 2022] DELETE /identity/v3/users/9f51713ae75548c7a64efa53ed18c414 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:54.358274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:54.358771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:54.359044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:54.383701 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:54.385402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:54.404371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:54.516879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1302/2559] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:54.528009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:54.529786 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:54.705767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6066f-1479-497f-9613-6cea3b418fd4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:54.709445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:54.710149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:54.710426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:54.710699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:54.741584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:54.746167 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:54.796972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1258/2560] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:55.391658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:55.393420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:55.423929 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24df9-b422-4625-816a-a9f20f6a318c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:55.431766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:55.432304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:55.432585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:55.432883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] PATH_INFO: `/v3/projects/a3aafa644b714a2cb126cb72a174e486` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:55.434049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3aafa644b714a2cb126cb72a174e486)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:55.436650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:55.503656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3aafa644b714a2cb126cb72a174e486', 'request_id': 'req-35515ab3-99ef-46a5-b00c-a94f9753dc36'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.515007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3aafa644b714a2cb126cb72a174e486', 'request_id': 'req-35515ab3-99ef-46a5-b00c-a94f9753dc36'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.529384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3aafa644b714a2cb126cb72a174e486', 'request_id': 'req-35515ab3-99ef-46a5-b00c-a94f9753dc36'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.548101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] The token cache is being invalidate because project a3aafa644b714a2cb126cb72a174e486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:55.548752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.549676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.552064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1303/2561] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:55 2022] DELETE /identity/v3/projects/a3aafa644b714a2cb126cb72a174e486 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:55.556453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:55.568378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845177d-cfa5-4e78-9af2-0b3e30c0c21d service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:55.630674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:55.631315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:55.631590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:55.631857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] PATH_INFO: `/v3/users/14b7d9bfbd734653963a9a689b5ab6f2` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:55.632996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b7d9bfbd734653963a9a689b5ab6f2)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:55.634985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:55.705653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:55.720245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b7d9bfbd734653963a9a689b5ab6f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.736107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b7d9bfbd734653963a9a689b5ab6f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.737994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b7d9bfbd734653963a9a689b5ab6f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.739545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b7d9bfbd734653963a9a689b5ab6f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.755584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b7d9bfbd734653963a9a689b5ab6f2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:55.776714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1259/2562] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:55 2022] DELETE /identity/v3/users/14b7d9bfbd734653963a9a689b5ab6f2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:56.192037 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.193776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.214616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515ab3-99ef-46a5-b00c-a94f9753dc36 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.264487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.266300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.357337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.358279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.358703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.359442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] PATH_INFO: `/v3/projects/080120fabef9406d85e232ca9c4cd3c8` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.361300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] RBAC: Authorizing `identity:delete_project(project_id=080120fabef9406d85e232ca9c4cd3c8)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.363600 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.407371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b3f33-8f75-4b63-bb90-5fe6b50895cd admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.412389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.413160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.413419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.413699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] PATH_INFO: `/v3/users/93b7a979cff8457089aab3f383715e19` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.414893 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b7a979cff8457089aab3f383715e19)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.416958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.448799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:56.451115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080120fabef9406d85e232ca9c4cd3c8', 'request_id': 'req-bd7ce085-288d-4ac4-a494-e9e412e4989e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.462064 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080120fabef9406d85e232ca9c4cd3c8', 'request_id': 'req-bd7ce085-288d-4ac4-a494-e9e412e4989e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.485775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080120fabef9406d85e232ca9c4cd3c8', 'request_id': 'req-bd7ce085-288d-4ac4-a494-e9e412e4989e'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.517239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b7a979cff8457089aab3f383715e19'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.522421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] The token cache is being invalidate because project 080120fabef9406d85e232ca9c4cd3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:56.522752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.523438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bd7ce085-288d-4ac4-a494-e9e412e4989e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.525435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1304/2563] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:56 2022] DELETE /identity/v3/projects/080120fabef9406d85e232ca9c4cd3c8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:56.530432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326440-8279-4c6c-bf01-b78d4cb6464a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.530715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326440-8279-4c6c-bf01-b78d4cb6464a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.530984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326440-8279-4c6c-bf01-b78d4cb6464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.531104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b7a979cff8457089aab3f383715e19'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.532750 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b7a979cff8457089aab3f383715e19'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.535394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b7a979cff8457089aab3f383715e19'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.543865 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1b3baa47-6a64-49e9-88ed-827623d46c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b7a979cff8457089aab3f383715e19'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:56.569182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f5326440-8279-4c6c-bf01-b78d4cb6464a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:56.571264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f5326440-8279-4c6c-bf01-b78d4cb6464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.581223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1260/2564] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:56 2022] DELETE /identity/v3/users/93b7a979cff8457089aab3f383715e19 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:56.583077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.584038 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.586695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.623631 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:56.624910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.653490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:56.696216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1261/2565] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:56.705875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1305/2566] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:56.710369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.713523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.713917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.714286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.718272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.737325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:56.738607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.756659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1306/2567] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:56.760459 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.770601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d6c7c-99a6-4735-9d89-21f3a255c0f5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.776345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.777369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.778019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.778515 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.779451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:56.780053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.781847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.794541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1307/2568] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:04:56.798963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.805846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c206f-db1e-4be2-ba1e-c92ed6a936bb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.810102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.810732 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.811011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.811282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.820251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6419-26cb-499b-b651-c891dbe87c4c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.825016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.825699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.825914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.826183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.826974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.828917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.831042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.832509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.859386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1308/2570] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:56 2022] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:56.863309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.864681 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1262/2570] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:56.932355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62f7cf-32c4-42d3-9b02-223b24aae287 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.937856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.938708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.939087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.939458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.940278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.942511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.978834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1309/2571] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:56 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:56.980578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.994569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a17a6-480f-4540-b46b-d37957ab3d5a service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.000159 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.001309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.001703 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.002072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.002824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.004556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.036448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1263/2572] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:57.037972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.074225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759e709-9b47-4dbc-94b6-12c411995ac3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.080982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8baace-3463-453f-b85c-0a92ac065bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.081996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8baace-3463-453f-b85c-0a92ac065bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.081996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8baace-3463-453f-b85c-0a92ac065bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.082903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8baace-3463-453f-b85c-0a92ac065bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.083140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8baace-3463-453f-b85c-0a92ac065bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.084834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8baace-3463-453f-b85c-0a92ac065bfd admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.100417 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1310/2573] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:57.101737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.112859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5632de-994b-4c13-8581-74f40c5486ae admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.121142 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.121881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.122255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.122630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] PATH_INFO: `/v3/projects/1a4a6af2e0b847e98dfc1631efbf1160/users/97dbbfae23874c2885ae6f3d611f18e7/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.153774 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4a6af2e0b847e98dfc1631efbf1160, user_id=97dbbfae23874c2885ae6f3d611f18e7, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.157664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.187910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1264/2574] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:57 2022] PUT /identity/v3/projects/1a4a6af2e0b847e98dfc1631efbf1160/users/97dbbfae23874c2885ae6f3d611f18e7/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:57.199961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.200272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.200573 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.211902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.218603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:57.245212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:57.250267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] MFA Rules not processed for user `97dbbfae23874c2885ae6f3d611f18e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:57.252549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:57.295176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135e48-dba3-4825-83fc-1c5226ce44e1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.313535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.314203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.314481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.314773 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] PATH_INFO: `/v3/projects/6a6060bd67584d1c8a35264482556727` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.317326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6060bd67584d1c8a35264482556727)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.320076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.339490 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1311/2575] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:57.344247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.359598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c7af5-fe75-4161-9b24-e5233c550761 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.366852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.368050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.368506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.369012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.369945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.371282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:57.373905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.379424 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6060bd67584d1c8a35264482556727', 'request_id': 'req-f2231246-d517-40b2-b0a0-575396135e94'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:57.390638 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6060bd67584d1c8a35264482556727', 'request_id': 'req-f2231246-d517-40b2-b0a0-575396135e94'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:57.408125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6060bd67584d1c8a35264482556727', 'request_id': 'req-f2231246-d517-40b2-b0a0-575396135e94'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:57.414152 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1312/2576] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:57.432874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.441871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] The token cache is being invalidate because project 6a6060bd67584d1c8a35264482556727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:57.442884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:57.445780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f2231246-d517-40b2-b0a0-575396135e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:57.449747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1265/2577] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:57 2022] DELETE /identity/v3/projects/6a6060bd67584d1c8a35264482556727 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:57.454419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805c7f3-e5cb-4ce9-9f25-47b49edef4a8 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.454700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805c7f3-e5cb-4ce9-9f25-47b49edef4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.454971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805c7f3-e5cb-4ce9-9f25-47b49edef4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.486898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3805c7f3-e5cb-4ce9-9f25-47b49edef4a8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:57.497557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3805c7f3-e5cb-4ce9-9f25-47b49edef4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:57.550350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cb21c-8f5a-4d4c-95d3-d729b392d4b8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.576710 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.577634 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.577989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.578329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.580340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.583165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.589465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1266/2578] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:57.606966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.607257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.607535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.636257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:57.643311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:57.647691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1313/2579] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:57.649530 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.656166 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1267/2580] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:57.657460 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:57.657657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.678032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e8fcb-1a31-4e45-b5d2-83636f9df6cc None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.678295 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df792-0b3f-401b-b495-830482dd49b3 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.697756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.698426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.698695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.698963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.701492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.708758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.708758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.708758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.708758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.709184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.709282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:57.709282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.709282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.720180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1314/2581] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:57.721843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.734592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1268/2582] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:57.739661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.753782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8791b9-4eff-4367-b2a8-8f4b1e9a63e9 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.757356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a2e0-7fcf-486c-962b-4cdc79d75737 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.759977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.761047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.761554 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.762041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] PATH_INFO: `/v3/projects/285efed5fbf14f7e9ef212bb5eceeaef/users/8c72d221eddd41e5b68ba25f277ef59b/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.763958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.765204 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.765595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.765877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.780765 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.782470 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285efed5fbf14f7e9ef212bb5eceeaef, user_id=8c72d221eddd41e5b68ba25f277ef59b, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.783119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.786345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.843096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1269/2584] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:57.843922 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1315/2584] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:57 2022] PUT /identity/v3/projects/285efed5fbf14f7e9ef212bb5eceeaef/users/8c72d221eddd41e5b68ba25f277ef59b/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:57.844341 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.845537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.899920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:57.938625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59ce7a-1c5e-4cc0-9f98-0c5135a121b4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.943368 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.944733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.945020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.945210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d39ad3-8ff5-46cc-a9b3-ae8e791f4dea admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.945354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.946233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.948150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.950724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.951621 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.952053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:57.952475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:57.953300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:57.955146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:57.970506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1270/2585] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:57.971795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.989974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1316/2586] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:57 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:57.990901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:57.992740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c40c53-be06-462f-a354-8ca8cbf6676a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:57.998539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900187a-9a51-4480-bbf5-4e3f4e3070ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:57.999477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900187a-9a51-4480-bbf5-4e3f4e3070ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:57.999994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900187a-9a51-4480-bbf5-4e3f4e3070ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.000386 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900187a-9a51-4480-bbf5-4e3f4e3070ef admin admin] PATH_INFO: `/v3/projects/285efed5fbf14f7e9ef212bb5eceeaef/users/8c72d221eddd41e5b68ba25f277ef59b/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.002763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900187a-9a51-4480-bbf5-4e3f4e3070ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=285efed5fbf14f7e9ef212bb5eceeaef, user_id=8c72d221eddd41e5b68ba25f277ef59b, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.002998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21d947-b376-4772-a3a0-3fb6387e5988 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:58.006129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900187a-9a51-4480-bbf5-4e3f4e3070ef admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.008139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:58.009096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.009374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.009641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.010798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.012533 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.019583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1271/2587] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:57 2022] PUT /identity/v3/projects/285efed5fbf14f7e9ef212bb5eceeaef/users/8c72d221eddd41e5b68ba25f277ef59b/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:58.030275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.030562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.030831 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.035212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1317/2588] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:58.036234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:58.046912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc3354-1bf9-4d20-90a7-8513802e20b4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:58.055666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:58.066785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] MFA Rules not processed for user `8c72d221eddd41e5b68ba25f277ef59b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:58.068044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:58.137874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:58.138541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.138849 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.139083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.139740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.145499 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.169700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1272/2589] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:58.177857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1318/2590] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:58.178647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:58.188588 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:58.190501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:58.190853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36dcf7-e3d3-4385-9304-5e4a79c2c81f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:58.195857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b0854-3be9-4b48-99dd-581aba9046f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:58.196817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0854-3be9-4b48-99dd-581aba9046f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.197089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0854-3be9-4b48-99dd-581aba9046f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.197359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b0854-3be9-4b48-99dd-581aba9046f6 admin admin] PATH_INFO: `/v3/projects/26a6cfa43a5a4547b0e69ade64710d4b/users/21d82deba63b4fe7bc7194a96dd3e4d9/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.214879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0854-3be9-4b48-99dd-581aba9046f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a6cfa43a5a4547b0e69ade64710d4b, user_id=21d82deba63b4fe7bc7194a96dd3e4d9, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.217775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b0854-3be9-4b48-99dd-581aba9046f6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.244779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1273/2591] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:58 2022] PUT /identity/v3/projects/26a6cfa43a5a4547b0e69ade64710d4b/users/21d82deba63b4fe7bc7194a96dd3e4d9/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:58.246548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.246834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.247145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.285695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] MFA Rules not processed for user `21d82deba63b4fe7bc7194a96dd3e4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:58.287200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:58.318420 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0860d-f0ff-40d3-a62e-b5f98ba27fa2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:58.373284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1274/2592] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:58.380918 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:58.381535 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.381813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.382079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.385956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:58.393897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:58.404581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:58.407419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92f824-325d-48e7-a4a4-c3f48b2fffed None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:58.411223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:58.411748 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.412037 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.412291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.427972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.429860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.441473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1275/2593] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:58.473328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.475020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.486330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1319/2594] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:58.537391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:58.548057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2a76a-1db4-484f-b436-3a662d7ba0b2 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:58.565252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:58.567676 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:58.568274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:58.571310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:58.574176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:58.678027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:58.737998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:58.739471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd9824-0223-4c07-a252-a85eff24b4e2 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:58.765138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1276/2595] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:02.566757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:02.654292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c827b-5178-459f-8b49-eb53b2b18b7f service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:02.659247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:02.660186 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:02.660875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:02.660875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] PATH_INFO: `/v3/users/97dbbfae23874c2885ae6f3d611f18e7` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:02.662293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dbbfae23874c2885ae6f3d611f18e7)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:02.665401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:02.761137 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dbbfae23874c2885ae6f3d611f18e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:02.771197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dbbfae23874c2885ae6f3d611f18e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:02.772184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dbbfae23874c2885ae6f3d611f18e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:02.772801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dbbfae23874c2885ae6f3d611f18e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:02.781177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dbbfae23874c2885ae6f3d611f18e7'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:02.804666 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1320/2596] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:02 2022] DELETE /identity/v3/users/97dbbfae23874c2885ae6f3d611f18e7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:02.808640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:02.809728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:02.810496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:02.842855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:02.844119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:02.918058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1277/2597] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:02.928220 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:02.929791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:02.983547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:03.010121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b28ea2-d70a-4463-ae22-d7a92c121301 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:03.016122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:03.016858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:03.017242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:03.017574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:03.033367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:03.035146 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:03.049172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1321/2598] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:03.355984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:03.357757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:03.379355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8242734-ee86-4bc1-aa9d-36f165e8551b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:03.384739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:03.385914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:03.386194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:03.386439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] PATH_INFO: `/v3/projects/1a4a6af2e0b847e98dfc1631efbf1160` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:03.387578 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4a6af2e0b847e98dfc1631efbf1160)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:03.389586 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:03.446516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4a6af2e0b847e98dfc1631efbf1160', 'request_id': 'req-49575328-8b2c-48d1-a807-d97afdfaeb95'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.453391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4a6af2e0b847e98dfc1631efbf1160', 'request_id': 'req-49575328-8b2c-48d1-a807-d97afdfaeb95'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.462504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4a6af2e0b847e98dfc1631efbf1160', 'request_id': 'req-49575328-8b2c-48d1-a807-d97afdfaeb95'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.473249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] The token cache is being invalidate because project 1a4a6af2e0b847e98dfc1631efbf1160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:03.473464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.474112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.475880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1278/2599] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:03 2022] DELETE /identity/v3/projects/1a4a6af2e0b847e98dfc1631efbf1160 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:03.479757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:03.489860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d65fb-44b8-4bab-8e81-7b71409884d0 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:03.560823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:03.561503 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:03.561776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:03.562050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] PATH_INFO: `/v3/users/8c72d221eddd41e5b68ba25f277ef59b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:03.563191 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c72d221eddd41e5b68ba25f277ef59b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:03.565153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:03.619401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c72d221eddd41e5b68ba25f277ef59b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.629126 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c72d221eddd41e5b68ba25f277ef59b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.630184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c72d221eddd41e5b68ba25f277ef59b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.631061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c72d221eddd41e5b68ba25f277ef59b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.639882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-95ea9e00-d145-4b90-9242-aa6ff2c72441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c72d221eddd41e5b68ba25f277ef59b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:03.664208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1322/2600] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:03 2022] DELETE /identity/v3/users/8c72d221eddd41e5b68ba25f277ef59b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:04.077900 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.079156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:04.122098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49575328-8b2c-48d1-a807-d97afdfaeb95 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.235081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.236321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.236853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.237392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] PATH_INFO: `/v3/projects/285efed5fbf14f7e9ef212bb5eceeaef` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.238969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285efed5fbf14f7e9ef212bb5eceeaef)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.241398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.261917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:04.353644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285efed5fbf14f7e9ef212bb5eceeaef', 'request_id': 'req-304051a2-8d0e-40f3-a7fc-1142f1452055'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:04.362604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285efed5fbf14f7e9ef212bb5eceeaef', 'request_id': 'req-304051a2-8d0e-40f3-a7fc-1142f1452055'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:04.375716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285efed5fbf14f7e9ef212bb5eceeaef', 'request_id': 'req-304051a2-8d0e-40f3-a7fc-1142f1452055'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:04.400199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] The token cache is being invalidate because project 285efed5fbf14f7e9ef212bb5eceeaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:04.400496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:04.401209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-304051a2-8d0e-40f3-a7fc-1142f1452055 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:04.402951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1279/2601] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:04 2022] DELETE /identity/v3/projects/285efed5fbf14f7e9ef212bb5eceeaef => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:04.409608 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.409900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.410222 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.451648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:04.452956 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:04.507088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:04.525313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1323/2602] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:04.527171 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.527550 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.527890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.548223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:04.549573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:04.559457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1280/2603] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:04.563774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.575426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132938-336f-418d-b2a9-99ff753101b7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.581637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.582337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.582615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.582984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.584158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:04.584158 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.585914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.600824 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1324/2604] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:05:04.605672 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.618666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad68c26-ea67-4913-b0a8-1aef6ab5cb83 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.623675 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.624332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.624647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.624905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.625682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.628272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.662988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1281/2605] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:04 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:04.667335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.678313 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a11da-ef50-4174-87e6-02b5634bcd0d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.750495 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.751875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.752161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.752436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.753279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.755218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.781421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1325/2606] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:04 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:04.785657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.797533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fc8e7-88f4-4da1-a44a-f77ab6257b43 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.802385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.803088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.803443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.803804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.804606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.806438 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.820937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1282/2607] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:04.821601 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.832415 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3d03-b932-4d88-9e71-662f628f82ac admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.837298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b8308-42a8-4937-80c3-c602afe59450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.837980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b8308-42a8-4937-80c3-c602afe59450 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.838323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b8308-42a8-4937-80c3-c602afe59450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.838604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b8308-42a8-4937-80c3-c602afe59450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.839247 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b8308-42a8-4937-80c3-c602afe59450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.841354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b8308-42a8-4937-80c3-c602afe59450 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.854242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1326/2608] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:04.858553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:04.868972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1f8c6-9c81-4caf-a89b-2ff12ea3f00d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:04.874533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:04.875564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.876468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.876874 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] PATH_INFO: `/v3/projects/8dd06969e40a4945b42d8770ee2e959b/users/05f3cda5b8e3435abcc21d37cd8a3c52/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.896122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd06969e40a4945b42d8770ee2e959b, user_id=05f3cda5b8e3435abcc21d37cd8a3c52, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:04.898836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:04.914240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1283/2609] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:04 2022] PUT /identity/v3/projects/8dd06969e40a4945b42d8770ee2e959b/users/05f3cda5b8e3435abcc21d37cd8a3c52/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:04.925678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:04.925991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:04.926267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:04.954382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] MFA Rules not processed for user `05f3cda5b8e3435abcc21d37cd8a3c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:04.955740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:05.020324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1327/2610] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:05.025028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.087820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d979c-99a4-4746-810f-dbb6a15fa906 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.092705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.093326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.093615 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.093888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.094526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.096463 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.128930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1284/2611] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:05 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:05.133100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.144437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb9cff-d5e6-4451-b71a-8a337fa025b7 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.193051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:05.203575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.204190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.204465 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.204775 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.205403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.207377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.228730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1328/2612] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:05 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:05.232942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.243537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ff2d2-d98c-4fa6-a914-60de4567e65e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.249198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.249803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.250079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.250346 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.251385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.253059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.264098 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1285/2613] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:05.268353 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.279198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff2b30-0905-406e-b182-88c4fe9e6c8e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.284795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.285458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.285747 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.286012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] PATH_INFO: `/v3/projects/67285001dfc24b7a8f754026859f170b/users/03d027f562364e7b810cac303a117414/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.302331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67285001dfc24b7a8f754026859f170b, user_id=03d027f562364e7b810cac303a117414, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.305031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.319805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1329/2614] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:05 2022] PUT /identity/v3/projects/67285001dfc24b7a8f754026859f170b/users/03d027f562364e7b810cac303a117414/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:05.324082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.339614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f0dff-18a0-4949-bdbf-0cc24b1bace1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.348505 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:05.401460 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7f5ca-8416-4537-a6ee-d812cd3f3b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.402175 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f5ca-8416-4537-a6ee-d812cd3f3b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.402439 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f5ca-8416-4537-a6ee-d812cd3f3b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.402724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7f5ca-8416-4537-a6ee-d812cd3f3b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.403370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f5ca-8416-4537-a6ee-d812cd3f3b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.405008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7f5ca-8416-4537-a6ee-d812cd3f3b88 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.418188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1286/2615] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:05.422975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.442442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ab88-4ddf-4538-8dcf-172022f8d833 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.455421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.456776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.457138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.459913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] PATH_INFO: `/v3/projects/67285001dfc24b7a8f754026859f170b/users/03d027f562364e7b810cac303a117414/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.461950 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67285001dfc24b7a8f754026859f170b, user_id=03d027f562364e7b810cac303a117414, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.464679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.476111 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1330/2616] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:05 2022] PUT /identity/v3/projects/67285001dfc24b7a8f754026859f170b/users/03d027f562364e7b810cac303a117414/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:05.486682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.487027 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.487973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.517060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] MFA Rules not processed for user `03d027f562364e7b810cac303a117414`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:05.518073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:05.597875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1287/2617] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:05.610974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:05.613233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:05.674618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcd25e-457f-46a7-844e-5b02619a1c96 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:05.678302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:05.678901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:05.679172 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:05.679439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:05.688105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:05.689567 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:05.698943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1331/2618] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:06.045842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:06.054962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940b605-dd41-4af9-86c3-0d31d2c2f215 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:06.059733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d027f562364e7b810cac303a117414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67285001dfc24b7a8f754026859f170b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:06.060353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:06.060667 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:06.060938 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:06.061589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:06.061892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:06.063512 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:06.075112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1288/2619] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:06.079438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:06.088906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eeb798-0b13-4ff7-b432-8c19c402ada0 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:06.093905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d027f562364e7b810cac303a117414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67285001dfc24b7a8f754026859f170b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:06.094494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:06.094785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:06.095054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:06.095679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:06.097719 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:06.127825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1332/2620] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:06 2022] POST /identity/v3/projects => generated 353 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:06.132079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:06.142805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae57af-d533-4254-92ea-e62ed81de4a1 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:06.202564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d027f562364e7b810cac303a117414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67285001dfc24b7a8f754026859f170b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:06.203200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:06.203464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:06.203741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:06.204389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:06.204741 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:06.206381 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:06.218465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1289/2621] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:06.258861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:06.269684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9567fb3-8c0b-4a05-b7f5-7ca9a003ef3c tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:06.274457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03d027f562364e7b810cac303a117414', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67285001dfc24b7a8f754026859f170b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:06.275086 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:06.275365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:06.275639 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] PATH_INFO: `/v3/projects/82a9aefe99004c78899da4311b3d368a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:06.276818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82a9aefe99004c78899da4311b3d368a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:06.278716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:06.327411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a9aefe99004c78899da4311b3d368a', 'request_id': 'req-5a236be8-341d-48aa-b1a5-d8a653f7b10a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.334110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a9aefe99004c78899da4311b3d368a', 'request_id': 'req-5a236be8-341d-48aa-b1a5-d8a653f7b10a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.343187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a9aefe99004c78899da4311b3d368a', 'request_id': 'req-5a236be8-341d-48aa-b1a5-d8a653f7b10a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.353818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] The token cache is being invalidate because project 82a9aefe99004c78899da4311b3d368a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:06.354102 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.354731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-5a236be8-341d-48aa-b1a5-d8a653f7b10a tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.356228 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1333/2622] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:06 2022] DELETE /identity/v3/projects/82a9aefe99004c78899da4311b3d368a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:06.653704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:06.655448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:06.673083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:06.731704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e65396-cd49-4f7a-bd46-cdb302b14f02 tempest-VolumeQuotaClassesTest-1663957569 tempest-VolumeQuotaClassesTest-1663957569-project-admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:06.800931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:06.801678 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:06.802128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:06.802472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] PATH_INFO: `/v3/users/05f3cda5b8e3435abcc21d37cd8a3c52` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:06.804130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f3cda5b8e3435abcc21d37cd8a3c52)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:06.806481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:06.869994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f3cda5b8e3435abcc21d37cd8a3c52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.882130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f3cda5b8e3435abcc21d37cd8a3c52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.883888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f3cda5b8e3435abcc21d37cd8a3c52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.886724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f3cda5b8e3435abcc21d37cd8a3c52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.902914 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f3cda5b8e3435abcc21d37cd8a3c52'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:06.942247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1290/2623] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:06 2022] DELETE /identity/v3/users/05f3cda5b8e3435abcc21d37cd8a3c52 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:06.943653 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:06.944517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:06.944836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:06.984045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:06.985648 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:06.991185 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:07.070858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1334/2624] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:07.086692 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:07.088330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:07.147288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:07.167730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:07.168519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e8345-7837-4a33-8285-03865ef17c75 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:07.169144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:07.172385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:07.173109 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:07.173447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:07.173718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:07.180962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee39e53-7cdf-4cf2-b106-ca8a20e8bdeb None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:07.183090 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:07.184594 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:07.184752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:07.185338 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:07.185620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:07.185896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:07.187584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:07.194742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1291/2625] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:07.200557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:07.202065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:07.212500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1335/2626] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:07.476259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:07.478407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:07.493290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28108484-3810-43a5-98e2-f4c02a494777 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:07.499785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:07.501770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:07.502177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:07.502597 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] PATH_INFO: `/v3/projects/8dd06969e40a4945b42d8770ee2e959b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:07.504066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd06969e40a4945b42d8770ee2e959b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:07.505910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:07.556298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd06969e40a4945b42d8770ee2e959b', 'request_id': 'req-8174c520-5a40-407e-97ac-15d6b313144e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.562524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd06969e40a4945b42d8770ee2e959b', 'request_id': 'req-8174c520-5a40-407e-97ac-15d6b313144e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.570282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd06969e40a4945b42d8770ee2e959b', 'request_id': 'req-8174c520-5a40-407e-97ac-15d6b313144e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.580999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] The token cache is being invalidate because project 8dd06969e40a4945b42d8770ee2e959b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:07.581280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.581896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.583603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1292/2627] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:07 2022] DELETE /identity/v3/projects/8dd06969e40a4945b42d8770ee2e959b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:07.587604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:07.597165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3909ff-c53f-4b2e-b7e9-ca66c0c5c751 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:07.655217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:07.655884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:07.656142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:07.656410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] PATH_INFO: `/v3/users/03d027f562364e7b810cac303a117414` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:07.657788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d027f562364e7b810cac303a117414)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:07.661782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:07.713907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d027f562364e7b810cac303a117414'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.723972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d027f562364e7b810cac303a117414'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.724734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d027f562364e7b810cac303a117414'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.725330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d027f562364e7b810cac303a117414'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.733094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-f7929400-6323-48d9-8c24-e898a137a27c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d027f562364e7b810cac303a117414'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:07.758739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1336/2628] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:07 2022] DELETE /identity/v3/users/03d027f562364e7b810cac303a117414 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:08.223926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.225445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:08.246287 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174c520-5a40-407e-97ac-15d6b313144e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.358701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.359367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.359659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.359915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] PATH_INFO: `/v3/projects/67285001dfc24b7a8f754026859f170b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.361923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67285001dfc24b7a8f754026859f170b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.364829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:08.425856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67285001dfc24b7a8f754026859f170b', 'request_id': 'req-359f5bcc-5b54-496c-8135-09bd8d7410c6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:08.428123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67285001dfc24b7a8f754026859f170b', 'request_id': 'req-359f5bcc-5b54-496c-8135-09bd8d7410c6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:08.441592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67285001dfc24b7a8f754026859f170b', 'request_id': 'req-359f5bcc-5b54-496c-8135-09bd8d7410c6'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:08.449304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:08.458511 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] The token cache is being invalidate because project 67285001dfc24b7a8f754026859f170b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:08.458813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:08.459598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-359f5bcc-5b54-496c-8135-09bd8d7410c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:08.462819 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1293/2629] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:08 2022] DELETE /identity/v3/projects/67285001dfc24b7a8f754026859f170b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:08.467897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.468400 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.468487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.490195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:08.491436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:08.503003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:08.559904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1337/2630] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:08.567849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.568131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.568397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.606646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:08.606646 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:08.618296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1294/2631] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:08.622733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.639974 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4f8b-50f5-46dc-984a-3ef069a15bb8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.647661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.648458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.648857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.649323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.650281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:08.651078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.653524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:08.674562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1338/2632] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:08.679473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.690189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8ccfe-702d-49b8-aa19-0bccb6cdf5a1 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.695144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.695754 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.696056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.696353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.697092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.699500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:08.730309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1295/2633] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:08 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:08.734734 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.745115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5361-8514-45c2-9689-267e77d0c206 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.809984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.810731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.811016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.811289 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.811926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.813879 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:08.837986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1339/2634] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:08 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:08.843268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.865964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1aeeb0-44de-43a6-b42c-a971c5e33a8d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.872802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.873642 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.875618 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.877379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.878612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.880539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:08.894764 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1296/2635] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:08.897738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.911722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b24c-6c67-4547-aa0a-5f0d2508e794 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.917207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b225f-1d9d-426d-9c4a-ead6ecaa2134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.917840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b225f-1d9d-426d-9c4a-ead6ecaa2134 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.918120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b225f-1d9d-426d-9c4a-ead6ecaa2134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.918391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b225f-1d9d-426d-9c4a-ead6ecaa2134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.919047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b225f-1d9d-426d-9c4a-ead6ecaa2134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.920813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b225f-1d9d-426d-9c4a-ead6ecaa2134 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:08.936865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1340/2636] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:08.938153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:08.951079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e1b22-5ef5-4702-9621-5bf197670f18 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:08.962931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:08.970384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:08.970668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:08.971389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] PATH_INFO: `/v3/projects/adf1f4c3126f4c85b369d720e847e81e/users/dbfbfcedd753470aafb5110278fb770d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:08.989884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf1f4c3126f4c85b369d720e847e81e, user_id=dbfbfcedd753470aafb5110278fb770d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:08.994859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.033435 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.033937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1297/2637] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:08 2022] PUT /identity/v3/projects/adf1f4c3126f4c85b369d720e847e81e/users/dbfbfcedd753470aafb5110278fb770d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:09.034311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.034779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.087564 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] MFA Rules not processed for user `dbfbfcedd753470aafb5110278fb770d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:09.089072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:09.166759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1341/2638] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:09.171768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.239560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287f6c5-a876-4744-9a13-2652c638a176 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.245305 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.246076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.246701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.246976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.247614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:09.249600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.283367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1298/2639] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:09 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:09.287673 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.299985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93012f34-5d62-42ba-87d8-ff2fafe59e8c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.311766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:09.382585 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.383350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.383757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.384054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.384726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:09.386697 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.420546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1342/2640] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:09 2022] POST /identity/v3/users => generated 307 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:09.424107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.458030 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329508-2888-4685-90d1-098a6e32df42 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.472830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.473489 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.473766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.474793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.475572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:09.478509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.491838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1299/2641] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:09.495856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.514011 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30240a9-811f-4ad0-9cf2-37384938ff75 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.530001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.530799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.531073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.531372 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] PATH_INFO: `/v3/projects/7a3fb5fa06294b5cbd8072be44f9b136/users/e132a4157de544d2a3d5dc1a516a9d83/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.553665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3fb5fa06294b5cbd8072be44f9b136, user_id=e132a4157de544d2a3d5dc1a516a9d83, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:09.557098 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.585274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1343/2642] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:09 2022] PUT /identity/v3/projects/7a3fb5fa06294b5cbd8072be44f9b136/users/e132a4157de544d2a3d5dc1a516a9d83/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:09.590024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.600268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105c16-33dd-43bf-b706-b590f40cda92 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.714673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206d88-0c99-471a-99fd-1f84768fe737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.715431 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206d88-0c99-471a-99fd-1f84768fe737 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.715896 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206d88-0c99-471a-99fd-1f84768fe737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.716228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206d88-0c99-471a-99fd-1f84768fe737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.716985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d206d88-0c99-471a-99fd-1f84768fe737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:09.718910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d206d88-0c99-471a-99fd-1f84768fe737 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.732644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1300/2643] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:09.735700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.747678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b00bdd-c024-47e5-8429-c0768a3ac442 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.753279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.753964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.754243 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.754619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] PATH_INFO: `/v3/projects/7a3fb5fa06294b5cbd8072be44f9b136/users/e132a4157de544d2a3d5dc1a516a9d83/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.756527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3fb5fa06294b5cbd8072be44f9b136, user_id=e132a4157de544d2a3d5dc1a516a9d83, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:09.759260 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:09.770424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1344/2644] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:09 2022] PUT /identity/v3/projects/7a3fb5fa06294b5cbd8072be44f9b136/users/e132a4157de544d2a3d5dc1a516a9d83/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:09.781082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.781563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.781924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.789796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:09.815707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] MFA Rules not processed for user `e132a4157de544d2a3d5dc1a516a9d83`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:09.817233 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:09.912447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1301/2645] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:09.925047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:09.928099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:09.994328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78099d29-a307-4c7c-b9b3-c6b8255a4445 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:09.998180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:09.998803 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.999085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.999360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:10.009257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:10.010687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:10.021128 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1345/2646] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:09 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:10.114538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:10.125127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c141b-4156-46cd-ba50-80989fec1f9c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:10.129361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67959-c0d3-4d82-aa0f-f5c5af296dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:10.129972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67959-c0d3-4d82-aa0f-f5c5af296dbf service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:10.130249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67959-c0d3-4d82-aa0f-f5c5af296dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:10.130516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67959-c0d3-4d82-aa0f-f5c5af296dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:10.203539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67959-c0d3-4d82-aa0f-f5c5af296dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:10.205756 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67959-c0d3-4d82-aa0f-f5c5af296dbf service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:10.216549 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1302/2647] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:10.893300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:10.895267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:10.979161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5d77f-baa7-41ba-ac1e-efca776cbfc4 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:10.983757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:10.984399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:10.984707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:10.985003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] PATH_INFO: `/v3/users/21d82deba63b4fe7bc7194a96dd3e4d9` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:10.986131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d82deba63b4fe7bc7194a96dd3e4d9)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:10.988077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:10.994478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:11.041319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d82deba63b4fe7bc7194a96dd3e4d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.049676 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d82deba63b4fe7bc7194a96dd3e4d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.050328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d82deba63b4fe7bc7194a96dd3e4d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.051078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d82deba63b4fe7bc7194a96dd3e4d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.059328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d82deba63b4fe7bc7194a96dd3e4d9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.077926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1346/2648] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:10 2022] DELETE /identity/v3/users/21d82deba63b4fe7bc7194a96dd3e4d9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:11.082598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.083145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.083145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.107060 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:11.108301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.170960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1303/2649] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:11.181630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:11.183223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.246665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40c2b-c6b5-48ea-a7ea-3feae36dc12a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:11.251377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:11.252013 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.252483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.252790 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.265144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:11.266729 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:11.277806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1347/2650] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:11.391340 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:11.393107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.406461 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2429e93-4c87-4470-949d-3e0ffd69ba4c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:11.411477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:11.412185 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.412524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.412899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] PATH_INFO: `/v3/users/285df012f70e4176ac99f05cd8271b44` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.414082 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285df012f70e4176ac99f05cd8271b44)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:11.416196 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:11.444147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:11.475599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285df012f70e4176ac99f05cd8271b44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.484658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285df012f70e4176ac99f05cd8271b44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.485409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285df012f70e4176ac99f05cd8271b44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.486757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285df012f70e4176ac99f05cd8271b44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.510108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285df012f70e4176ac99f05cd8271b44'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.533330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1304/2651] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:11 2022] DELETE /identity/v3/users/285df012f70e4176ac99f05cd8271b44 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:11.583651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:11.583651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.606230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495fe39-caea-48dc-9379-35329bec4290 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:11.684187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:11.685025 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.685395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.685766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] PATH_INFO: `/v3/projects/26a6cfa43a5a4547b0e69ade64710d4b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.687182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a6cfa43a5a4547b0e69ade64710d4b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:11.689605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:11.740014 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:11.765477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:11.769757 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.780805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a6cfa43a5a4547b0e69ade64710d4b', 'request_id': 'req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.792235 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb195063-9014-4f3d-be9c-f1fec8771ff7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:11.796278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a6cfa43a5a4547b0e69ade64710d4b', 'request_id': 'req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.816798 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a6cfa43a5a4547b0e69ade64710d4b', 'request_id': 'req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.833047 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] The token cache is being invalidate because project 26a6cfa43a5a4547b0e69ade64710d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:11.833363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.834378 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-bcaebbd8-44d8-4008-9d4a-6b673c962e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.839461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1348/2652] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:11 2022] DELETE /identity/v3/projects/26a6cfa43a5a4547b0e69ade64710d4b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:11.841327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a55e-e92b-4e23-bfe1-dca4c312b5ac None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.841619 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a55e-e92b-4e23-bfe1-dca4c312b5ac None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.842061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a55e-e92b-4e23-bfe1-dca4c312b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.869192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b3a5a55e-e92b-4e23-bfe1-dca4c312b5ac None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:11.870438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b3a5a55e-e92b-4e23-bfe1-dca4c312b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.879637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:11.880350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.880643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.880759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1349/2653] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:11.885071 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] PATH_INFO: `/v3/projects/94106a5745e54651a48c1e43d7752120` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.887469 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=94106a5745e54651a48c1e43d7752120)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:11.888907 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.889254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.889529 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.890721 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:11.915375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:11.917242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:11.926261 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1350/2654] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:11.931469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:11.943187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bd012-c0f6-4b89-a3de-fef465856881 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:11.948692 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:11.949318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:11.949809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:11.950274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:11.951415 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:11.951869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:11.954176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:11.976727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1351/2655] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:11.980387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:11.984130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94106a5745e54651a48c1e43d7752120', 'request_id': 'req-523364ea-6f85-47e0-8a11-b9539becb6bf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:11.996998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94106a5745e54651a48c1e43d7752120', 'request_id': 'req-523364ea-6f85-47e0-8a11-b9539becb6bf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:12.001464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9875a-d4ae-4fe4-b9ce-a21adcf85396 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.018308 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94106a5745e54651a48c1e43d7752120', 'request_id': 'req-523364ea-6f85-47e0-8a11-b9539becb6bf'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:12.045986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] The token cache is being invalidate because project 94106a5745e54651a48c1e43d7752120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:12.046275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:12.047005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-523364ea-6f85-47e0-8a11-b9539becb6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:12.049228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1305/2656] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:11 2022] DELETE /identity/v3/projects/94106a5745e54651a48c1e43d7752120 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:12.055177 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64e8e-973e-44f0-be0c-64004fd42208 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.056493 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64e8e-973e-44f0-be0c-64004fd42208 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.056941 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b64e8e-973e-44f0-be0c-64004fd42208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.083509 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-69b64e8e-973e-44f0-be0c-64004fd42208 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:12.084087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.084830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.084975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-69b64e8e-973e-44f0-be0c-64004fd42208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:12.085233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.085562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.086442 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.091811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.105190 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1306/2657] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:12.114077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.114372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.114687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.137205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1352/2658] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:11 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:12.138521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.139356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:12.140579 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:12.141893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:12.173155 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:12.217319 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343367f-d77a-4e08-a529-960c0e282f6a admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.222989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.223820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.224281 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.224568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.225251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.227208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.248880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1307/2659] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:12.251536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.257439 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1353/2660] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:12.262755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.270372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89658283-d950-4119-88dc-2b3ec9018582 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.275498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a11c06-07f2-4ce7-bd8c-9b24b66f950e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.280042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.281495 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.281879 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.282250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.282996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:12.283379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.283794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.285232 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.285754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.286113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.286354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.287456 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.291038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.293566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:12.307252 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1308/2661] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:12.309981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1354/2662] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:12.314567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.315901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.325198 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504cc319-e573-476b-9f01-26f72dd11017 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.329964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.330572 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.330851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.331119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.331790 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.333217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45017b3-7191-4a3a-9035-33c8b5a86a3c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.333402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.337941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.338556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.338831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.339127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.339788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.341787 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.344701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1309/2663] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:12.349100 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.360240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a37b2-cb60-4f56-badf-f7b8aeb8ddea admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.365985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7945b-1f8e-4e5e-84cd-2aff881e9654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.367015 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7945b-1f8e-4e5e-84cd-2aff881e9654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.367402 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7945b-1f8e-4e5e-84cd-2aff881e9654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.368068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7945b-1f8e-4e5e-84cd-2aff881e9654 admin admin] PATH_INFO: `/v3/projects/5121f1b51f9546ad93d9f56d86038d4c/users/97e4e1101f8a41b1ae08a4ef9297cdf6/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.375951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1355/2664] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:12.380592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.384800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7945b-1f8e-4e5e-84cd-2aff881e9654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5121f1b51f9546ad93d9f56d86038d4c, user_id=97e4e1101f8a41b1ae08a4ef9297cdf6, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.388262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7945b-1f8e-4e5e-84cd-2aff881e9654 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.403354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1310/2665] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:12 2022] PUT /identity/v3/projects/5121f1b51f9546ad93d9f56d86038d4c/users/97e4e1101f8a41b1ae08a4ef9297cdf6/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:12.415415 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.415719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.415970 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.444844 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] MFA Rules not processed for user `97e4e1101f8a41b1ae08a4ef9297cdf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:12.446612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:12.455621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030d59a-1099-43aa-9d66-8ae19da6127d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.518563 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1311/2666] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:12.518831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.519371 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.519656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.519924 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.520566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.522900 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.523023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.535036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb2ebf-ca6e-47b4-a62a-8dd5934d1d0f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.540382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.541127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.541444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.541745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.542453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.544477 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.548711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1356/2667] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:12.553050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.563165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d94d7-aba4-42fa-97f2-02852a6b46f6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.568446 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.569116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.569428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.569753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.570421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.572073 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.577971 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1312/2668] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:12.578995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.586360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1357/2669] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:12.588004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.602604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2da51-73b3-44c3-a018-3c01567a204f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.628101 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:12.648538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b0284-f52e-4403-8fd3-a6508735685f admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.653538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.654150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.654420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.654687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.655327 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.657620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.663367 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.664060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.664407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.664840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.665584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.667258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.668777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:12.687359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1313/2670] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:12.687595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1358/2671] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:12.687701 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.689144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.698184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13475dff-1123-4c6b-b03f-28754b379618 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.704240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae842-f14b-4718-a439-82f5e81ab948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.705066 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae842-f14b-4718-a439-82f5e81ab948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.705348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae842-f14b-4718-a439-82f5e81ab948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.705619 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae842-f14b-4718-a439-82f5e81ab948 admin admin] PATH_INFO: `/v3/projects/69ad584cd90f4e469b6059df58b76c42/users/fccbd1baf4a54eed956972fb5927a5e3/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.705861 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced1061-db1d-4fd9-9294-b7d90ec80f99 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.710468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.711208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.711558 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.712029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.712812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.714421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.723921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ae842-f14b-4718-a439-82f5e81ab948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ad584cd90f4e469b6059df58b76c42, user_id=fccbd1baf4a54eed956972fb5927a5e3, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.726543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1359/2672] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:12.726666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ae842-f14b-4718-a439-82f5e81ab948 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.730629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.741005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e630da-4c50-4ded-a5d1-6d6420145d3e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.743567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1314/2673] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:12 2022] PUT /identity/v3/projects/69ad584cd90f4e469b6059df58b76c42/users/fccbd1baf4a54eed956972fb5927a5e3/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:12.754716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.754973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.755259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.784322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] MFA Rules not processed for user `fccbd1baf4a54eed956972fb5927a5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:12.785494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:12.809644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.810743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.810743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.810994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.811702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.813485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.824743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1360/2674] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:12.828522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.839280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d1414-7751-41ab-a66d-a1f687dadd9c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.844986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3aeb3-d58a-45f0-8ae6-55b53a241a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.845731 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3aeb3-d58a-45f0-8ae6-55b53a241a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.846092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3aeb3-d58a-45f0-8ae6-55b53a241a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.846354 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3aeb3-d58a-45f0-8ae6-55b53a241a2e admin admin] PATH_INFO: `/v3/projects/426a6f37c7d74fd5890c82c88e2f565e/users/759893acc7f34424be5bada86a0238bc/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.856834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1315/2675] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:12.857936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.866043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3aeb3-d58a-45f0-8ae6-55b53a241a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=426a6f37c7d74fd5890c82c88e2f565e, user_id=759893acc7f34424be5bada86a0238bc, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.868844 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3aeb3-d58a-45f0-8ae6-55b53a241a2e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.871133 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6a816-187c-4791-9989-54bed06fd6ad None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.876556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.877254 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.877530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.877797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.878580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.880933 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.885106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1361/2676] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:12 2022] PUT /identity/v3/projects/426a6f37c7d74fd5890c82c88e2f565e/users/759893acc7f34424be5bada86a0238bc/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:12.895436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.895722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.895994 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.916434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1316/2677] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:12.918630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:12.925192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] MFA Rules not processed for user `759893acc7f34424be5bada86a0238bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:12.926408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:12.981292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e54641-3c6c-4885-975d-69376eaef282 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:12.986095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:12.986700 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:12.986978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:12.987251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:12.987894 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:12.989829 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:12.993892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1362/2678] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:12.998394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.010206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046627b-e6d8-4114-b4fd-2967e903b8ab None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.013253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1317/2679] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:13.017206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.018361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.018968 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.019252 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.019521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.020151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.022079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.023452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:13.028116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a9360-dc06-4642-93d5-bf46c30a4db3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.035711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.036248 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.036526 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.036830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.037464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.039077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.049766 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1318/2680] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:13.054013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.059305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1363/2681] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:12 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:13.060314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.063806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abf06b-d452-4362-8229-ae102cea4269 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.090265 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:13.122634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.123410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.123559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.123832 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] PATH_INFO: `/v3/projects/62883785d9bb47c0bf6f819c7c169c5c/users/7743eeb5235f42e69ad6f979dad7108a/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.134961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb2a11-8be6-4793-b854-47c421488c7f admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.138851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62883785d9bb47c0bf6f819c7c169c5c, user_id=7743eeb5235f42e69ad6f979dad7108a, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.139984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.140598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.140902 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.141173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.141639 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.141804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.143699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.156324 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1319/2682] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:13 2022] PUT /identity/v3/projects/62883785d9bb47c0bf6f819c7c169c5c/users/7743eeb5235f42e69ad6f979dad7108a/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:13.161649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.168896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1364/2683] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:13 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:13.172568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.186010 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad192a-9d78-4fe5-8b0c-4dc7db3390b5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.252625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e937a89-ef05-4395-8400-0f54e0ca7923 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.255195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.255856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.256142 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.256399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.257233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.258739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.259483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.259627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.259959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.260412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.261283 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.263207 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.272860 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1365/2684] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:13.276982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.281012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1320/2685] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:13.281975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.290932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724198c3-6cdc-492e-b49f-e0615a0ccadb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.292081 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46413a34-c0dc-466e-b7a4-a6ddc0f1f45e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.296007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.296864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.297291 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.297647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] PATH_INFO: `/v3/projects/2222cf51576f43d89751d9dd1b6ebca5/users/6cfbcbc0785b4663830a96845cca3dc0/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.297853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09d1fb-e3a4-434c-8007-3442dd8b86c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.298668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d1fb-e3a4-434c-8007-3442dd8b86c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.299085 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d1fb-e3a4-434c-8007-3442dd8b86c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.299465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09d1fb-e3a4-434c-8007-3442dd8b86c6 admin admin] PATH_INFO: `/v3/projects/62883785d9bb47c0bf6f819c7c169c5c/users/7743eeb5235f42e69ad6f979dad7108a/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.301986 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09d1fb-e3a4-434c-8007-3442dd8b86c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62883785d9bb47c0bf6f819c7c169c5c, user_id=7743eeb5235f42e69ad6f979dad7108a, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.304818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09d1fb-e3a4-434c-8007-3442dd8b86c6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.318029 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2222cf51576f43d89751d9dd1b6ebca5, user_id=6cfbcbc0785b4663830a96845cca3dc0, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.320573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1321/2686] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:13 2022] PUT /identity/v3/projects/62883785d9bb47c0bf6f819c7c169c5c/users/7743eeb5235f42e69ad6f979dad7108a/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:13.322274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.332656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3abdc-9158-4e71-ba5f-88c7c673485c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.332943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3abdc-9158-4e71-ba5f-88c7c673485c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.333718 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3abdc-9158-4e71-ba5f-88c7c673485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.352540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1366/2687] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:13 2022] PUT /identity/v3/projects/2222cf51576f43d89751d9dd1b6ebca5/users/6cfbcbc0785b4663830a96845cca3dc0/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:13.356225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.366818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-92d3abdc-9158-4e71-ba5f-88c7c673485c None None] MFA Rules not processed for user `7743eeb5235f42e69ad6f979dad7108a`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:13.368228 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-92d3abdc-9158-4e71-ba5f-88c7c673485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:13.461614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:13.465768 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630877-2492-4894-9644-dd782aadcf0e admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.471462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.472273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.472758 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.473329 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.474360 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.476207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.487390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1367/2688] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:13.491720 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.503391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58566389-4e98-4ff3-bef2-4bba27bd95d6 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.508770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1322/2689] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:13.511494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.512165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.512445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.512763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] PATH_INFO: `/v3/projects/2222cf51576f43d89751d9dd1b6ebca5/users/6cfbcbc0785b4663830a96845cca3dc0/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.514794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2222cf51576f43d89751d9dd1b6ebca5, user_id=6cfbcbc0785b4663830a96845cca3dc0, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.517699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.530592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1368/2690] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:13 2022] PUT /identity/v3/projects/2222cf51576f43d89751d9dd1b6ebca5/users/6cfbcbc0785b4663830a96845cca3dc0/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:13.541915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.542128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.542391 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.554169 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.557324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:13.572452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:13.576348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] MFA Rules not processed for user `6cfbcbc0785b4663830a96845cca3dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:13.577599 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:13.638903 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9f20f-2876-49f0-b9c0-fec6164643ae admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.643066 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.643693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.643985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.644804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.661468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1323/2691] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:13.678354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.679947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:13.693403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5ef5fe-f259-40bc-af38-d2fb7b3b0a8e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.698666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.699712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.700059 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.700589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.730990 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.733187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.750241 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1369/2692] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:13.769351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.770958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.773004 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:13.774651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:13.781849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1324/2693] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:13.851361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf984d07-545b-4650-a191-c1a989422e0b service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:13.855695 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:13.856875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:13.856875 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:13.857087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:13.858830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:13.935445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:13.936977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42adc53-d185-405e-bad5-4a562a864705 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:13.948280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1370/2694] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:14.235575 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:14.302788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8751a21-8805-461d-83d6-9e53a6f43d37 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:14.307472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:14.308103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:14.308413 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:14.308713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] PATH_INFO: `/v3/users/fccbd1baf4a54eed956972fb5927a5e3` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:14.309880 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccbd1baf4a54eed956972fb5927a5e3)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:14.311858 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:14.322440 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:14.362795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccbd1baf4a54eed956972fb5927a5e3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.370405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccbd1baf4a54eed956972fb5927a5e3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.371106 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccbd1baf4a54eed956972fb5927a5e3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.371728 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccbd1baf4a54eed956972fb5927a5e3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.381239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccbd1baf4a54eed956972fb5927a5e3'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.401451 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1325/2695] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:14 2022] DELETE /identity/v3/users/fccbd1baf4a54eed956972fb5927a5e3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:14.406555 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:14.407072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:14.407541 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:14.442762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:14.442762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:14.446336 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:14.508454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1371/2696] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:14.518519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:14.520111 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:14.578840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777c0fe-b8bf-4a03-9670-82ded4607acc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:14.582952 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:14.583680 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:14.583956 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:14.584368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:14.595178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:14.596661 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:14.607292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1326/2697] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:14.764675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:14.766559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:14.779579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b0fa8-16df-470a-9592-23d2f3d389a1 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:14.797407 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:14.798195 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:14.798482 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:14.799385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] PATH_INFO: `/v3/users/dbfbfcedd753470aafb5110278fb770d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:14.801129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbfbfcedd753470aafb5110278fb770d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:14.803166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:14.860325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbfbfcedd753470aafb5110278fb770d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.871264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbfbfcedd753470aafb5110278fb770d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.873050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbfbfcedd753470aafb5110278fb770d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.873774 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbfbfcedd753470aafb5110278fb770d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.883703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-d91ec488-330d-46cb-8ea2-a144f407bc53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbfbfcedd753470aafb5110278fb770d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:14.898074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:14.899943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:14.908366 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1372/2698] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:14 2022] DELETE /identity/v3/users/dbfbfcedd753470aafb5110278fb770d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:14.912859 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:14.913317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:14.913743 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:14.922239 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5c4bc-1c9a-479f-8665-7fd0dc8648bf service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:14.941726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:14.943283 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.002390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:15.003035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:15.003311 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:15.003580 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] PATH_INFO: `/v3/projects/69ad584cd90f4e469b6059df58b76c42` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:15.004726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ad584cd90f4e469b6059df58b76c42)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:15.005441 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1373/2699] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:15.006801 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:15.017099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:15.018496 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.046918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:15.051904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:15.067330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ad584cd90f4e469b6059df58b76c42', 'request_id': 'req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.074918 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ad584cd90f4e469b6059df58b76c42', 'request_id': 'req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.085014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ad584cd90f4e469b6059df58b76c42', 'request_id': 'req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.089426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a05b-e86b-470f-9296-3116b01da488 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:15.096910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] The token cache is being invalidate because project 69ad584cd90f4e469b6059df58b76c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:15.097202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.097846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.099622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1327/2700] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:14 2022] DELETE /identity/v3/projects/69ad584cd90f4e469b6059df58b76c42 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:15.103473 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:15.104974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.150032 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:15.150537 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:15.150823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:15.151094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:15.153079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.191536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce0eeb-57e8-446b-8cb4-30ee719beaf7 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:15.197478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:15.198232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:15.198581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:15.198985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] PATH_INFO: `/v3/users/7743eeb5235f42e69ad6f979dad7108a` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:15.202188 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7743eeb5235f42e69ad6f979dad7108a)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:15.205139 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:15.222575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:15.224413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:15.238050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1374/2701] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:15.276897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7743eeb5235f42e69ad6f979dad7108a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.287392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7743eeb5235f42e69ad6f979dad7108a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.288518 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7743eeb5235f42e69ad6f979dad7108a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.289369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7743eeb5235f42e69ad6f979dad7108a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.298396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7743eeb5235f42e69ad6f979dad7108a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:15.322601 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1328/2702] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:15 2022] DELETE /identity/v3/users/7743eeb5235f42e69ad6f979dad7108a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:15.453024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:15.454528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.517132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cd764-5e88-4c49-84e9-c42565ce129c service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:15.559616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:15.568675 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:15.569562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:15.569813 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:15.570080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:15.571906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.634427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:15.635981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:15.645613 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1375/2703] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:15.823860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:15.825827 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.844917 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:15.846622 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:15.890928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:15.924072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac0c8b-08b1-4218-909b-2f51ee1527bc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:15.931643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:15.934369 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:15.934749 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:15.935454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] PATH_INFO: `/v3/projects/adf1f4c3126f4c85b369d720e847e81e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:15.937457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf1f4c3126f4c85b369d720e847e81e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:15.939542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.039979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f24e05-84f4-4b96-9d8b-38d7a97a376c service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.058687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf1f4c3126f4c85b369d720e847e81e', 'request_id': 'req-8fdc8008-8ba5-436b-bf04-bb736470dc24'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.068836 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf1f4c3126f4c85b369d720e847e81e', 'request_id': 'req-8fdc8008-8ba5-436b-bf04-bb736470dc24'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.082121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf1f4c3126f4c85b369d720e847e81e', 'request_id': 'req-8fdc8008-8ba5-436b-bf04-bb736470dc24'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.103983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] The token cache is being invalidate because project adf1f4c3126f4c85b369d720e847e81e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:16.104548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.105624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.109339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1329/2704] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:15 2022] DELETE /identity/v3/projects/adf1f4c3126f4c85b369d720e847e81e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:16.113566 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.115225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.232991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.233422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.233604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.233865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] PATH_INFO: `/v3/projects/62883785d9bb47c0bf6f819c7c169c5c` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.235218 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62883785d9bb47c0bf6f819c7c169c5c)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.237381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.250855 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc8008-8ba5-436b-bf04-bb736470dc24 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.262240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.262975 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.263302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.264332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] PATH_INFO: `/v3/users/e132a4157de544d2a3d5dc1a516a9d83` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.266362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e132a4157de544d2a3d5dc1a516a9d83)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.268991 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.329518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:16.332543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62883785d9bb47c0bf6f819c7c169c5c', 'request_id': 'req-6e3174c1-6cbe-46df-a931-c4ca10c59200'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.352188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62883785d9bb47c0bf6f819c7c169c5c', 'request_id': 'req-6e3174c1-6cbe-46df-a931-c4ca10c59200'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.374699 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62883785d9bb47c0bf6f819c7c169c5c', 'request_id': 'req-6e3174c1-6cbe-46df-a931-c4ca10c59200'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.394590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e132a4157de544d2a3d5dc1a516a9d83'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.399687 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] The token cache is being invalidate because project 62883785d9bb47c0bf6f819c7c169c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:16.400893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.401852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-6e3174c1-6cbe-46df-a931-c4ca10c59200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.403830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1376/2705] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:15 2022] DELETE /identity/v3/projects/62883785d9bb47c0bf6f819c7c169c5c => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:16.409864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e132a4157de544d2a3d5dc1a516a9d83'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.410614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e132a4157de544d2a3d5dc1a516a9d83'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.411525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e132a4157de544d2a3d5dc1a516a9d83'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.418297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.418837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.419359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.449419 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-3a123baf-f3c4-4c96-9ab0-52d0301b6629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e132a4157de544d2a3d5dc1a516a9d83'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:16.466663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:16.482988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1330/2706] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:16 2022] DELETE /identity/v3/users/e132a4157de544d2a3d5dc1a516a9d83 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:16.486197 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:16.487722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.623673 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.624278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.624995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.634051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1377/2707] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:16.659453 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:16.661068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.687846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1331/2708] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:16.692757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.719058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc828-1290-4659-ad9e-7ad5f04e3d6d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.738618 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.739851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.740285 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.740846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.741963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.742424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:16.743184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.743430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.745440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.765199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1378/2709] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:16.767440 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.792553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d9430-0193-4115-8bf5-c92a8e926fa5 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.806569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.808658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.809328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.810151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.811931 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.814067 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:16.854058 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabbf42-bc33-4b84-835d-b63f6880715f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:16.862331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:16.862979 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:16.863255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:16.863521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:16.874231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:16.892030 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1379/2710] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:16 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:16.896233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:16.995588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:16.997264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.002604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cafb8-523a-4aaf-994b-15661af5883c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.007611 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.008309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.009581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.009581 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.010101 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.013192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.018388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1332/2711] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:17.053776 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1380/2712] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:16 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:17.058243 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.077589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05d7b2-d0d5-47e2-bcc1-608601d3696e service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.089189 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.089960 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.090329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.094394 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.095640 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.097565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.111607 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1333/2713] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:17.116097 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.133182 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37238f8-3c36-45f2-8d16-8291e0c3d40b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.139829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.140749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.141093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.141485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.142237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.144341 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.183640 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1381/2714] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:17.187467 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.191364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.193740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.204797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a4093-fbe0-4dc7-b9bc-6b7c586b9c62 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.214399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429a613-f3c2-45c8-bda3-c9c33a882f43 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.215999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fc2d5-a5c4-49cf-9157-89aefccea246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.217192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc2d5-a5c4-49cf-9157-89aefccea246 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.217932 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc2d5-a5c4-49cf-9157-89aefccea246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.218268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fc2d5-a5c4-49cf-9157-89aefccea246 admin admin] PATH_INFO: `/v3/projects/06a34b626fba4e23a8fdf7d31cdd8c9a/users/e9e97a991f164f6daf4728529fbbb4da/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.221034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.222150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.222584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.223063 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] PATH_INFO: `/v3/projects/7a3fb5fa06294b5cbd8072be44f9b136` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.225264 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3fb5fa06294b5cbd8072be44f9b136)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.227858 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.244908 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fc2d5-a5c4-49cf-9157-89aefccea246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a34b626fba4e23a8fdf7d31cdd8c9a, user_id=e9e97a991f164f6daf4728529fbbb4da, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.249999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fc2d5-a5c4-49cf-9157-89aefccea246 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.253806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:17.296853 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1334/2715] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:17 2022] PUT /identity/v3/projects/06a34b626fba4e23a8fdf7d31cdd8c9a/users/e9e97a991f164f6daf4728529fbbb4da/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:17.303728 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3fb5fa06294b5cbd8072be44f9b136', 'request_id': 'req-2eca83b8-6946-417b-945c-f853b04c713b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.308388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.308852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.309234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.312324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3fb5fa06294b5cbd8072be44f9b136', 'request_id': 'req-2eca83b8-6946-417b-945c-f853b04c713b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.337652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3fb5fa06294b5cbd8072be44f9b136', 'request_id': 'req-2eca83b8-6946-417b-945c-f853b04c713b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.349279 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] MFA Rules not processed for user `e9e97a991f164f6daf4728529fbbb4da`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:17.350705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.350943 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] The token cache is being invalidate because project 7a3fb5fa06294b5cbd8072be44f9b136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:17.351288 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.351941 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-2eca83b8-6946-417b-945c-f853b04c713b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:17.353786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1382/2716] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:17 2022] DELETE /identity/v3/projects/7a3fb5fa06294b5cbd8072be44f9b136 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:17.358340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b33dad-7e6d-4e0b-aff7-aa8c1742f6e8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.358615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b33dad-7e6d-4e0b-aff7-aa8c1742f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.358886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b33dad-7e6d-4e0b-aff7-aa8c1742f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.386700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b3b33dad-7e6d-4e0b-aff7-aa8c1742f6e8 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:17.388213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b3b33dad-7e6d-4e0b-aff7-aa8c1742f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.413043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:17.445937 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1335/2717] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:17.450138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.451547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.467851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1383/2718] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:17.477498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.477848 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.478125 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.500977 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:17.502566 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:17.510890 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1384/2719] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:17.514670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.524206 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3f59-69c8-424f-a410-7e7b1fb596fd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.529546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.530060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.530340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.530616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.531267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:17.531569 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.533205 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.540074 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443be73-cb5d-496c-a7fe-d6212d57c38d None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.545872 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.549843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1385/2720] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:05:17.549984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.549984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.549984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.549984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.549984 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.551822 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.567296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8653a-7c5f-49e7-a7dd-28eea066f44d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.577986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.579140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.579140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.579434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.579569 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1336/2721] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:17.580445 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.582531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.583294 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.618948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1386/2722] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:17.620092 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.658751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a6615-484b-4d7b-b81d-af1d2812e38e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.689793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f764b-0b1f-4392-9d48-69fdaaaa0eae admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.697287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.698020 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.698384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.698721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.699363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.701321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.710670 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:17.719802 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.720557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.720898 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.721362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.722251 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.724537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.727239 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1387/2723] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:17.732411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.743180 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966ea57-9078-4c4d-9e91-33d1892b4cb4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.751610 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.752124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.752375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.752738 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.753462 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.754121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1337/2724] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:17.755188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.757536 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.769421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1388/2725] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:17.769608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd0cc-53c3-43dc-98bf-a124a1ef0a24 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.770471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.773063 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.773708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.773983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.774332 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.774978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.776649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.779357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:17.781346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bcfd1-35f8-43af-91f6-387d78f1cc73 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.787038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.787645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.787914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.788183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.788872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.789541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1338/2726] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:17.790629 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.793450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.803459 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91731-2be9-4363-a182-f633cf2a7e25 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.803652 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1389/2727] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:17.808077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.811634 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.812359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.812674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.812966 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] PATH_INFO: `/v3/projects/f0cd0de227c4435fb1b8cb88e2977402/users/13a63592438a47bdb48891dfe569362e/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.818324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5a8bc-4c94-460a-a3d1-978a7f997998 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.824912 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f4ed5-190c-4707-8b7d-d13b47188a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:17.825744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f4ed5-190c-4707-8b7d-d13b47188a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.826083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f4ed5-190c-4707-8b7d-d13b47188a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.826414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f4ed5-190c-4707-8b7d-d13b47188a4a admin admin] PATH_INFO: `/v3/projects/9f2a87ffa3b04a909e26d295272bcab5/users/db77636a0446485ba57937949899d3be/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.831581 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cd0de227c4435fb1b8cb88e2977402, user_id=13a63592438a47bdb48891dfe569362e, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.834296 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.842981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f4ed5-190c-4707-8b7d-d13b47188a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2a87ffa3b04a909e26d295272bcab5, user_id=db77636a0446485ba57937949899d3be, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:17.846005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f4ed5-190c-4707-8b7d-d13b47188a4a admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:17.849867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1339/2728] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:17 2022] PUT /identity/v3/projects/f0cd0de227c4435fb1b8cb88e2977402/users/13a63592438a47bdb48891dfe569362e/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:17.853553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:17.865892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1390/2729] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:17 2022] PUT /identity/v3/projects/9f2a87ffa3b04a909e26d295272bcab5/users/db77636a0446485ba57937949899d3be/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:17.926691 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8381f5e-1aa8-4bce-9577-f82ef6a2c53d admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:17.935864 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853514af-6d72-4471-8f53-12980c6c393b None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:17.936138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853514af-6d72-4471-8f53-12980c6c393b None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:17.936817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853514af-6d72-4471-8f53-12980c6c393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:17.966258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-853514af-6d72-4471-8f53-12980c6c393b None None] MFA Rules not processed for user `db77636a0446485ba57937949899d3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:17.967671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-853514af-6d72-4471-8f53-12980c6c393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:18.050752 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1391/2730] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:18.062233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853514af-6d72-4471-8f53-12980c6c393b None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:18.065278 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-853514af-6d72-4471-8f53-12980c6c393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:18.123710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:18.124472 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.124792 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.125232 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.126033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:18.128002 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.142902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1340/2731] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:18.147035 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:18.174668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7a6f4-61dd-41b1-b5c6-a0a453517ef8 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:18.177816 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853514af-6d72-4471-8f53-12980c6c393b None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:18.184123 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3abf1d-8b8b-4620-80ab-59f8700f16b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:18.186532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abf1d-8b8b-4620-80ab-59f8700f16b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.186793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:18.187140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abf1d-8b8b-4620-80ab-59f8700f16b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.187825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.188288 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abf1d-8b8b-4620-80ab-59f8700f16b1 admin admin] PATH_INFO: `/v3/projects/f0cd0de227c4435fb1b8cb88e2977402/users/13a63592438a47bdb48891dfe569362e/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.189081 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.190344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.192913 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3abf1d-8b8b-4620-80ab-59f8700f16b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0cd0de227c4435fb1b8cb88e2977402, user_id=13a63592438a47bdb48891dfe569362e, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:18.195810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3abf1d-8b8b-4620-80ab-59f8700f16b1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.210112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:18.213139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.236496 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1341/2732] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:18 2022] PUT /identity/v3/projects/f0cd0de227c4435fb1b8cb88e2977402/users/13a63592438a47bdb48891dfe569362e/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:18.236745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1392/2733] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:18.242208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.242582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.242949 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.306465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] MFA Rules not processed for user `13a63592438a47bdb48891dfe569362e`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:18.307954 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:18.384811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:18.430795 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1342/2734] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:18.646754 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:18.659826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c36341-0b7b-4463-a6f8-c4e4ef058024 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:18.778048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:18.802272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d28cc9-a6cb-401b-89de-958b302b502c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:18.803708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d28cc9-a6cb-401b-89de-958b302b502c service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:18.804094 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d28cc9-a6cb-401b-89de-958b302b502c service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:18.804586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d28cc9-a6cb-401b-89de-958b302b502c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:18.818563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d28cc9-a6cb-401b-89de-958b302b502c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:18.820363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d28cc9-a6cb-401b-89de-958b302b502c service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:18.835932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1393/2735] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:19.019191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:19.082546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aae05-5ba5-4fe2-9895-8db727730745 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:19.087218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:19.087848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:19.088122 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:19.088389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] PATH_INFO: `/v3/users/e9e97a991f164f6daf4728529fbbb4da` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:19.089573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e97a991f164f6daf4728529fbbb4da)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:19.091478 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:19.140247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e97a991f164f6daf4728529fbbb4da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.148948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e97a991f164f6daf4728529fbbb4da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.149587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e97a991f164f6daf4728529fbbb4da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.150183 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e97a991f164f6daf4728529fbbb4da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.157078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e97a991f164f6daf4728529fbbb4da'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.174624 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1343/2736] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:19 2022] DELETE /identity/v3/users/e9e97a991f164f6daf4728529fbbb4da => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:19.179385 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27417237-e7fa-41db-9536-c67356822c71 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:19.179872 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27417237-e7fa-41db-9536-c67356822c71 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:19.180085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27417237-e7fa-41db-9536-c67356822c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:19.200867 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-27417237-e7fa-41db-9536-c67356822c71 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:19.202085 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-27417237-e7fa-41db-9536-c67356822c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:19.265955 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1394/2737] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:19.275959 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:19.277450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:19.337005 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8330c2-e5cd-435f-b3dd-4452e3c3cc48 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:19.341385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:19.342108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:19.342538 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:19.342899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:19.352517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:19.353965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:19.363237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1344/2738] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:19.663153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27417237-e7fa-41db-9536-c67356822c71 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:19.664750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-27417237-e7fa-41db-9536-c67356822c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:19.677196 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27417237-e7fa-41db-9536-c67356822c71 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:19.682337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:19.683027 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:19.683323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:19.683596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] PATH_INFO: `/v3/projects/06a34b626fba4e23a8fdf7d31cdd8c9a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:19.684825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a34b626fba4e23a8fdf7d31cdd8c9a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:19.686935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:19.735307 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a34b626fba4e23a8fdf7d31cdd8c9a', 'request_id': 'req-fe536358-e4da-4246-a316-4d12f11a2007'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.741540 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a34b626fba4e23a8fdf7d31cdd8c9a', 'request_id': 'req-fe536358-e4da-4246-a316-4d12f11a2007'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.750053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a34b626fba4e23a8fdf7d31cdd8c9a', 'request_id': 'req-fe536358-e4da-4246-a316-4d12f11a2007'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.764060 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] The token cache is being invalidate because project 06a34b626fba4e23a8fdf7d31cdd8c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:19.764374 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.765035 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fe536358-e4da-4246-a316-4d12f11a2007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.766562 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1395/2739] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:19 2022] DELETE /identity/v3/projects/06a34b626fba4e23a8fdf7d31cdd8c9a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:19.770688 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:19.781851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a68f-f8b0-4a2d-8bcf-15a652e2f0d2 service neutron] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:19.788242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:19.788642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:19.788995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:19.790785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:19.810134 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] MFA Rules not processed for user `db77636a0446485ba57937949899d3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:19.811532 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:19.849247 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:19.849887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:19.850164 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:19.850571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] PATH_INFO: `/v3/users/13a63592438a47bdb48891dfe569362e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:19.851698 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a63592438a47bdb48891dfe569362e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:19.853780 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:19.875851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1396/2740] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:19.917446 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a63592438a47bdb48891dfe569362e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.927502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a63592438a47bdb48891dfe569362e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.928201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a63592438a47bdb48891dfe569362e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.928951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a63592438a47bdb48891dfe569362e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.941023 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-f0a00cc8-3f1f-4d30-b4d1-5926c4febabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a63592438a47bdb48891dfe569362e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:19.964241 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1345/2741] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:19 2022] DELETE /identity/v3/users/13a63592438a47bdb48891dfe569362e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:20.279214 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.280843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:20.298784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f8387-b94e-4ba3-aff9-24bd9baef4c6 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.304306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:20.366721 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.367395 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.367685 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.368008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] PATH_INFO: `/v3/projects/f0cd0de227c4435fb1b8cb88e2977402` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.369279 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0cd0de227c4435fb1b8cb88e2977402)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.371296 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.420160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0cd0de227c4435fb1b8cb88e2977402', 'request_id': 'req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:20.433226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0cd0de227c4435fb1b8cb88e2977402', 'request_id': 'req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:20.443217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0cd0de227c4435fb1b8cb88e2977402', 'request_id': 'req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:20.455403 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] The token cache is being invalidate because project f0cd0de227c4435fb1b8cb88e2977402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:20.455703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:20.456364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-ae82c084-2ab1-4d93-bb8e-b9ba37d68ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:20.458018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1397/2742] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:20 2022] DELETE /identity/v3/projects/f0cd0de227c4435fb1b8cb88e2977402 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:20.463976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.464259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.464535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.485662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:20.486867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:20.559234 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1346/2743] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:20.561131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.561413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.561684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.584225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:20.585586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:20.595681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1398/2744] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:20.600230 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.611268 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a55f2-199f-40f8-b420-1af167cd5f8c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.615926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.616529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.616897 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.617095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.617733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:20.618416 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.619635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.636367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1347/2745] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:20.638061 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.649245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6b60-1fcc-4d8c-bc05-98a2d48373f5 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.655402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.656110 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.656647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.657026 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.657786 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.659715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.691831 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1399/2746] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:20 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:20.695705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.706633 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91728d8-60d8-4f14-b4ac-ba2dfc2c8b1b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.720403 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:20.771061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.771867 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.772075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.772238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.773004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.775001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.797400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1348/2747] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:20 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:20.802023 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.814896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd8fe-319f-4989-ae91-c5640d9be6c4 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.820298 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.821054 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.821335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.821592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.822230 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.824084 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.834945 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1400/2748] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:20.839265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.849479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd784b-ab1d-4c7d-93a2-73179e6a140e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.854825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16415bdb-dafb-4623-8aef-05bd8d7590cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.855804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415bdb-dafb-4623-8aef-05bd8d7590cf admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.856138 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415bdb-dafb-4623-8aef-05bd8d7590cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.856409 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16415bdb-dafb-4623-8aef-05bd8d7590cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.857105 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16415bdb-dafb-4623-8aef-05bd8d7590cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.858770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16415bdb-dafb-4623-8aef-05bd8d7590cf admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.871056 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1349/2749] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:20.875664 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:20.887124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c357f-c8ec-4839-b7ae-0d681e9bc809 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:20.893418 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:20.894103 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.894394 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.894810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] PATH_INFO: `/v3/projects/be72f43541134ad2950e3961ad281fcc/users/501ff9f23fdf43eba221a153544b61a4/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.910592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=be72f43541134ad2950e3961ad281fcc, user_id=501ff9f23fdf43eba221a153544b61a4, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:20.913382 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:20.928753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1401/2750] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:20 2022] PUT /identity/v3/projects/be72f43541134ad2950e3961ad281fcc/users/501ff9f23fdf43eba221a153544b61a4/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:20.940292 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:20.940548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:20.940978 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:20.972577 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] MFA Rules not processed for user `501ff9f23fdf43eba221a153544b61a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:20.973905 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.046659 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1350/2751] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:21.051299 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.097344 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:21.125177 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b1e1a-56fb-47d6-bc9c-539efe92c4ae admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.130830 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.131636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.132050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.132388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.133079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.135932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.165314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1402/2752] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:21 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:21.169723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.181004 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119f3f2-0fe3-4e30-81a4-8bf3699c6cb0 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.240475 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.241200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.241479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.241746 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.242388 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.244351 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.271868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1351/2753] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:21 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:21.278267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.288904 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90b42c-a9cc-4693-bd1e-b0b90dbd6bec admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.294132 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.294751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.295350 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.295624 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.296271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.297906 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.310763 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1403/2754] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:21.315010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.326011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93ab1f-fcf6-4225-bd8b-936721ff5eac admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.330273 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.330851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.331517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.331791 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.332076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] PATH_INFO: `/v3/projects/6e486d289bbe48e294bce245a2eee10c/users/07d3f912a76a4753b49708b1cad88e3b/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.333044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.345014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:21.349366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e486d289bbe48e294bce245a2eee10c, user_id=07d3f912a76a4753b49708b1cad88e3b, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.351305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5261ae-a295-4d71-8209-f76b8847af76 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.352767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.356290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.357915 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.358130 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.358426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] PATH_INFO: `/v3/users/97e4e1101f8a41b1ae08a4ef9297cdf6` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.359886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e4e1101f8a41b1ae08a4ef9297cdf6)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.362389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.370769 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1352/2755] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:21 2022] PUT /identity/v3/projects/6e486d289bbe48e294bce245a2eee10c/users/07d3f912a76a4753b49708b1cad88e3b/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:21.374931 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.420584 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e4e1101f8a41b1ae08a4ef9297cdf6'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:21.434437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e4e1101f8a41b1ae08a4ef9297cdf6'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:21.435504 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e4e1101f8a41b1ae08a4ef9297cdf6'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:21.436173 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e4e1101f8a41b1ae08a4ef9297cdf6'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:21.444862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fad4fba4-3d9c-4665-90d0-3d9de73b96a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e4e1101f8a41b1ae08a4ef9297cdf6'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:21.450162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4266f-fff6-4176-9e94-88fe9c83016a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.457428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.459396 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.459851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.460302 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.461192 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.462927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.468909 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1404/2756] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:21 2022] DELETE /identity/v3/users/97e4e1101f8a41b1ae08a4ef9297cdf6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:21.473155 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.473471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.473755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.473887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1353/2757] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:21.477841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.479724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.495408 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:21.496682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.497354 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725e7a8-9daa-49fd-908b-0df2a4fc21ab admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.559596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1405/2758] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:21.559805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07c33f-6a89-4b0d-b3e2-f1f064280aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.560501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c33f-6a89-4b0d-b3e2-f1f064280aae admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.560808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c33f-6a89-4b0d-b3e2-f1f064280aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.561078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07c33f-6a89-4b0d-b3e2-f1f064280aae admin admin] PATH_INFO: `/v3/projects/6e486d289bbe48e294bce245a2eee10c/users/07d3f912a76a4753b49708b1cad88e3b/roles/ff6687245616423c8a3e42542a544932` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.563778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c33f-6a89-4b0d-b3e2-f1f064280aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e486d289bbe48e294bce245a2eee10c, user_id=07d3f912a76a4753b49708b1cad88e3b, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.568856 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07c33f-6a89-4b0d-b3e2-f1f064280aae admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.569892 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.571910 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.582095 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1354/2759] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:21 2022] PUT /identity/v3/projects/6e486d289bbe48e294bce245a2eee10c/users/07d3f912a76a4753b49708b1cad88e3b/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:21.594154 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.594437 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.594738 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.602952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:21.625510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] MFA Rules not processed for user `07d3f912a76a4753b49708b1cad88e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:21.627194 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.637631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8b34a-ab48-4113-a771-9b009ac98c8d None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.687233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.688078 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.688363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.688691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.702218 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1355/2760] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:21.723274 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.724839 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.736532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:21.760708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.762574 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.773170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1406/2761] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:21.809996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5129e14-74fb-45d2-a8bd-5da6d054f0cb None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.814420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.815129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.815522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.815859 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.826608 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:21.828042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:21.839649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1356/2762] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:21.961851 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:21.973757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080f86c-0b4d-4498-bd2d-650ccd18e81d service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:21.989579 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:21.990703 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.991089 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.991461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.993795 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:22.072393 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:22.073836 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:22.083036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1407/2763] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:22.256719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:22.258611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:22.276968 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7058b-5675-4cd7-b47a-1289754dcbfc service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:22.283962 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:22.284595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:22.284926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:22.285205 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] PATH_INFO: `/v3/projects/5121f1b51f9546ad93d9f56d86038d4c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:22.286587 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5121f1b51f9546ad93d9f56d86038d4c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:22.288502 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:22.347304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5121f1b51f9546ad93d9f56d86038d4c', 'request_id': 'req-a4d4323d-d5cf-4330-b17a-6261bccd0515'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.354089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5121f1b51f9546ad93d9f56d86038d4c', 'request_id': 'req-a4d4323d-d5cf-4330-b17a-6261bccd0515'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.370299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5121f1b51f9546ad93d9f56d86038d4c', 'request_id': 'req-a4d4323d-d5cf-4330-b17a-6261bccd0515'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.384016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] The token cache is being invalidate because project 5121f1b51f9546ad93d9f56d86038d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:22.384647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.385567 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.387881 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1357/2764] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:22 2022] DELETE /identity/v3/projects/5121f1b51f9546ad93d9f56d86038d4c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:22.393656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:22.405318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf8410-0a73-4373-90e9-712f48202da4 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:22.433522 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:22.500166 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:22.501000 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:22.501707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:22.502069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] PATH_INFO: `/v3/users/759893acc7f34424be5bada86a0238bc` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:22.503514 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759893acc7f34424be5bada86a0238bc)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:22.505471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:22.554744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759893acc7f34424be5bada86a0238bc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.563045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759893acc7f34424be5bada86a0238bc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.563971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759893acc7f34424be5bada86a0238bc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.564742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759893acc7f34424be5bada86a0238bc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.572845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759893acc7f34424be5bada86a0238bc'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:22.591160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1408/2765] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:22 2022] DELETE /identity/v3/users/759893acc7f34424be5bada86a0238bc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:22.884300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:22.886483 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:22.903471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4323d-d5cf-4330-b17a-6261bccd0515 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:22.972826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:22.973622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:22.973989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:22.974479 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] PATH_INFO: `/v3/projects/426a6f37c7d74fd5890c82c88e2f565e` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:22.975808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426a6f37c7d74fd5890c82c88e2f565e)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:22.978128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:23.026583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:23.036647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426a6f37c7d74fd5890c82c88e2f565e', 'request_id': 'req-1028bbae-4886-4d10-a03c-58f79bd195c9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.045805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426a6f37c7d74fd5890c82c88e2f565e', 'request_id': 'req-1028bbae-4886-4d10-a03c-58f79bd195c9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.058156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426a6f37c7d74fd5890c82c88e2f565e', 'request_id': 'req-1028bbae-4886-4d10-a03c-58f79bd195c9'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.075635 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] The token cache is being invalidate because project 426a6f37c7d74fd5890c82c88e2f565e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:23.075927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.076588 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.078556 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1358/2766] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:22 2022] DELETE /identity/v3/projects/426a6f37c7d74fd5890c82c88e2f565e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:23.082513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:23.084886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:23.098753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cef05c-f8ff-4c1c-85d6-1640724a44b8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:23.160805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:23.161501 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:23.161784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:23.162059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] PATH_INFO: `/v3/users/6cfbcbc0785b4663830a96845cca3dc0` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:23.163245 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfbcbc0785b4663830a96845cca3dc0)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:23.165308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:23.217135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfbcbc0785b4663830a96845cca3dc0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.218828 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:23.225714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfbcbc0785b4663830a96845cca3dc0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.226450 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfbcbc0785b4663830a96845cca3dc0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.229700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfbcbc0785b4663830a96845cca3dc0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.238187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-0abc8ef7-1b6e-4f52-adcb-a180e7b88294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfbcbc0785b4663830a96845cca3dc0'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.257641 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1409/2767] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:23 2022] DELETE /identity/v3/users/6cfbcbc0785b4663830a96845cca3dc0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:23.739742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:23.741504 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:23.767849 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028bbae-4886-4d10-a03c-58f79bd195c9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:23.845096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:23.845818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:23.846096 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:23.846363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] PATH_INFO: `/v3/projects/2222cf51576f43d89751d9dd1b6ebca5` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:23.847528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2222cf51576f43d89751d9dd1b6ebca5)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:23.849534 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:23.901426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2222cf51576f43d89751d9dd1b6ebca5', 'request_id': 'req-e9362a69-a27b-490c-a1d6-e51485b31a06'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.907929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2222cf51576f43d89751d9dd1b6ebca5', 'request_id': 'req-e9362a69-a27b-490c-a1d6-e51485b31a06'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.916001 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2222cf51576f43d89751d9dd1b6ebca5', 'request_id': 'req-e9362a69-a27b-490c-a1d6-e51485b31a06'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.927430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] The token cache is being invalidate because project 2222cf51576f43d89751d9dd1b6ebca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:23.927717 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.928382 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-e9362a69-a27b-490c-a1d6-e51485b31a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:23.930020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1359/2768] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:23 2022] DELETE /identity/v3/projects/2222cf51576f43d89751d9dd1b6ebca5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:23.935364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:23.935881 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:23.935982 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:23.956477 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:23.957901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:24.021511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1410/2769] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:24.029796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.030076 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.030370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.050643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:24.051847 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:24.060282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1360/2770] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:24.064914 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.074932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dd861-a963-4609-865d-29bfcadb43cd None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.079626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.080233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.080510 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.080873 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.081523 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:24.081826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.083483 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.098739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1411/2771] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:24.099999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.109539 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02465fc-3f99-4c25-9dd5-0fdcd5875510 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.114244 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.114851 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.115127 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.115395 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.116025 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.118086 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.146625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1361/2772] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:24 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:24.157779 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.168276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb29b71-1fdc-411f-b49c-090a13bcaede admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.226461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.227109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.227430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.227759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.228433 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.230375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.252784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1412/2773] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:24 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:24.257433 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.268366 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654a666-b9fd-4af7-a348-96a22075c556 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.273006 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.273611 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.273889 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.274191 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.274828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.276414 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.286609 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1362/2774] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:24.290874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.301479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad4aa-f25b-4884-a22b-85291823e198 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.306975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563adab-c0fe-4132-a168-06abc6bc6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.307592 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563adab-c0fe-4132-a168-06abc6bc6f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.307869 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563adab-c0fe-4132-a168-06abc6bc6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.308138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563adab-c0fe-4132-a168-06abc6bc6f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.308812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563adab-c0fe-4132-a168-06abc6bc6f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.310414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563adab-c0fe-4132-a168-06abc6bc6f53 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.321549 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1413/2775] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:24.325729 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.335723 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd24560-468f-41dd-96a7-15d4bf24e6e1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.340367 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.341200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.341481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.341752 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] PATH_INFO: `/v3/projects/08b52f024f0a485c80a6d6397af33e8b/users/1645e333a9da4b5d94eb45b06dc1adf8/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.352969 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:24.357658 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b52f024f0a485c80a6d6397af33e8b, user_id=1645e333a9da4b5d94eb45b06dc1adf8, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.361429 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.375768 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1363/2776] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:24 2022] PUT /identity/v3/projects/08b52f024f0a485c80a6d6397af33e8b/users/1645e333a9da4b5d94eb45b06dc1adf8/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:24.386478 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.386764 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.387065 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.414429 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] MFA Rules not processed for user `1645e333a9da4b5d94eb45b06dc1adf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:24.415646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:24.433726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:24.487124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1414/2777] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:24.498808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.500655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:24.563103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd352eb-06d8-441d-bccd-bbc7aa92575c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.568049 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2726de-a7b2-4c3f-8855-07b9fecc9d07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebe21ca5e9924e458c2d37c28e7ee1b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.568643 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2726de-a7b2-4c3f-8855-07b9fecc9d07 service glance] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.568965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2726de-a7b2-4c3f-8855-07b9fecc9d07 service glance] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.569231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2726de-a7b2-4c3f-8855-07b9fecc9d07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.578466 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2726de-a7b2-4c3f-8855-07b9fecc9d07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.579915 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2726de-a7b2-4c3f-8855-07b9fecc9d07 service glance] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.589747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1364/2778] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:24.822096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:24.823727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:24.896521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51d822-13a4-4cad-8e83-960e668d8992 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:24.901846 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:24.902638 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:24.902765 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:24.902995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] PATH_INFO: `/v3/users/501ff9f23fdf43eba221a153544b61a4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:24.904204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=501ff9f23fdf43eba221a153544b61a4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:24.907210 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:24.963332 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501ff9f23fdf43eba221a153544b61a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:24.972484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501ff9f23fdf43eba221a153544b61a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:24.973153 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501ff9f23fdf43eba221a153544b61a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:24.973773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501ff9f23fdf43eba221a153544b61a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:24.984165 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501ff9f23fdf43eba221a153544b61a4'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.028321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1415/2779] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:24 2022] DELETE /identity/v3/users/501ff9f23fdf43eba221a153544b61a4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:25.032686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.033203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.033203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.061685 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:25.063713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:25.135535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1365/2780] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:25.145834 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:25.147233 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:25.195138 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:25.213840 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5515b-9a80-44e0-96fb-1340cae35771 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:25.217755 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:25.218538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.218820 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.219095 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.230033 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:25.231614 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:25.244975 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1416/2781] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:25.560571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:25.562024 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:25.588445 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17973de-8b3e-4dca-a9a1-ae3d9d54400e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:25.595885 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:25.596524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.596823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.597088 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] PATH_INFO: `/v3/projects/be72f43541134ad2950e3961ad281fcc` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.598284 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be72f43541134ad2950e3961ad281fcc)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:25.600303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:25.654434 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be72f43541134ad2950e3961ad281fcc', 'request_id': 'req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.661548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be72f43541134ad2950e3961ad281fcc', 'request_id': 'req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.671626 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be72f43541134ad2950e3961ad281fcc', 'request_id': 'req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.683261 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] The token cache is being invalidate because project be72f43541134ad2950e3961ad281fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:25.683545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.684219 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.685810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1366/2782] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:25 2022] DELETE /identity/v3/projects/be72f43541134ad2950e3961ad281fcc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:25.690415 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:25.702674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17a8df-a22f-48c7-bb28-68adb7d71c67 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:25.769170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:25.769811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:25.770087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:25.770348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] PATH_INFO: `/v3/users/07d3f912a76a4753b49708b1cad88e3b` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:25.771595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d3f912a76a4753b49708b1cad88e3b)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:25.773589 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:25.824139 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d3f912a76a4753b49708b1cad88e3b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.834217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d3f912a76a4753b49708b1cad88e3b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.837254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d3f912a76a4753b49708b1cad88e3b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.837254 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d3f912a76a4753b49708b1cad88e3b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.844022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-fd0f853f-786e-45c7-8b5d-0c9ef3906ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d3f912a76a4753b49708b1cad88e3b'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:25.862426 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1417/2783] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:25 2022] DELETE /identity/v3/users/07d3f912a76a4753b49708b1cad88e3b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:26.150787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.152474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:26.167711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf272e7f-9ce1-41a5-988e-51fc6d273a5e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.181345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:26.230623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.231176 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.231452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.231722 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] PATH_INFO: `/v3/projects/6e486d289bbe48e294bce245a2eee10c` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.232871 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e486d289bbe48e294bce245a2eee10c)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.234814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.288359 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e486d289bbe48e294bce245a2eee10c', 'request_id': 'req-515c8d07-878e-46ee-92c0-37ee03b4e0d2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:26.294482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e486d289bbe48e294bce245a2eee10c', 'request_id': 'req-515c8d07-878e-46ee-92c0-37ee03b4e0d2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:26.302805 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e486d289bbe48e294bce245a2eee10c', 'request_id': 'req-515c8d07-878e-46ee-92c0-37ee03b4e0d2'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:26.313600 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] The token cache is being invalidate because project 6e486d289bbe48e294bce245a2eee10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:26.313890 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:26.314532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-515c8d07-878e-46ee-92c0-37ee03b4e0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:26.316045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1367/2784] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:26 2022] DELETE /identity/v3/projects/6e486d289bbe48e294bce245a2eee10c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:26.321117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.321597 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.321751 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.341999 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:26.343204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:26.408184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1418/2785] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:26.416360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.416677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.417020 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.442039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:26.443375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:26.452170 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1368/2786] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:26.456607 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.461705 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:26.468375 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdfac4-c276-4d12-ad79-5fc002967146 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.474475 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.475077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.475355 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.475625 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.476272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:26.476572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.478286 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.489985 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1419/2787] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:05:26.494660 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.505231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d667f-ff99-4049-a7f5-d4846f38f867 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.510055 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.510668 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.510934 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.511203 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.511842 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.513784 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.542948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1369/2788] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:26 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:26.548949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.564570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306848-5ed3-476f-ba69-6a555fe8748d admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.629170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.629799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.630129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.630335 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.630962 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.632948 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.656249 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1420/2789] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:26 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:26.660321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.671553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d682e-3912-49de-85ba-0b3bd6aa6219 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.676357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.677012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.677289 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.677560 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.678197 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.679834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.691390 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1370/2790] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:26.695492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.705773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c45c8e-4467-47a5-b0c7-732c18a7c87c admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.710961 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d882f-d0d1-4931-8443-0838b8ce8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.711833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d882f-d0d1-4931-8443-0838b8ce8be4 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.712204 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d882f-d0d1-4931-8443-0838b8ce8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.712570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d882f-d0d1-4931-8443-0838b8ce8be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.713980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d882f-d0d1-4931-8443-0838b8ce8be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.716805 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4d882f-d0d1-4931-8443-0838b8ce8be4 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.729160 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1421/2791] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:26.733379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.744242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3de5-7e6a-4f87-b269-54f3553e0e61 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.748781 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.749524 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.749695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.749972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] PATH_INFO: `/v3/projects/e4fccb1cbe4f4340bb88b3792dff9c5d/users/acc809ce900647e89bc5f01cde03ec39/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.766551 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4fccb1cbe4f4340bb88b3792dff9c5d, user_id=acc809ce900647e89bc5f01cde03ec39, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:26.769490 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:26.792356 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1371/2792] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:26 2022] PUT /identity/v3/projects/e4fccb1cbe4f4340bb88b3792dff9c5d/users/acc809ce900647e89bc5f01cde03ec39/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:26.804161 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.804736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.805207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.837715 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] MFA Rules not processed for user `acc809ce900647e89bc5f01cde03ec39`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:26.838989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:26.914630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1422/2793] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:26.919137 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:26.965355 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:26.991590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669329c-7847-484f-b1b3-efd790d96062 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:26.996868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:26.997423 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:26.997664 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:26.997957 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:26.998584 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.000486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.029474 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1372/2794] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:26 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:27.033655 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.044536 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff965f2c-246b-4580-8799-81f923f3e454 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.097762 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:27.104888 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.105489 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.105771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.106201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.107001 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.109309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.136865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1423/2795] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:27 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:27.137920 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.148519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01afc-279d-4868-9a30-efa9b7be6752 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.153530 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.154117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.154387 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.154669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.155278 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.156888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.167582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1373/2796] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:27.171744 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.181843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b493-94a2-4924-b6f7-6169a0201622 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.191988 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26c376-ec0a-4c76-8bb6-5fa45807a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.192635 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26c376-ec0a-4c76-8bb6-5fa45807a106 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.192920 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26c376-ec0a-4c76-8bb6-5fa45807a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.193190 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26c376-ec0a-4c76-8bb6-5fa45807a106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.193854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26c376-ec0a-4c76-8bb6-5fa45807a106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.195476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26c376-ec0a-4c76-8bb6-5fa45807a106 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.207458 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1424/2797] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:27.211686 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.222145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2a6dd-fcab-466b-ab81-1f68488f06c4 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.227301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.227963 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.228237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.228507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] PATH_INFO: `/v3/projects/0e9563d5f3f1476dbad7f8c3e1fbc448/users/313f88c64a5d410aa330f7f752dc4afb/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.243972 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9563d5f3f1476dbad7f8c3e1fbc448, user_id=313f88c64a5d410aa330f7f752dc4afb, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.246637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.267270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1374/2798] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:27 2022] PUT /identity/v3/projects/0e9563d5f3f1476dbad7f8c3e1fbc448/users/313f88c64a5d410aa330f7f752dc4afb/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:27.277559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.277826 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.278106 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.307436 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] MFA Rules not processed for user `313f88c64a5d410aa330f7f752dc4afb`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:27.308727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:27.380981 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1425/2799] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:27.385854 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.459043 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402f97a-9b74-456b-89db-59b90099263a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.465186 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.465815 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.466092 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.466353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.466997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.468928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.497950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1375/2800] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:27.502498 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.515016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623600-a9c3-4ea7-81c9-c6c20258f2a8 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.575785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.576317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.576596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.576905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.577526 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.579451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.601694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1426/2801] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:27 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:27.606053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.616443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7daa5-0a59-405d-b85b-e3e4c1e82ec6 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.621482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.622073 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.622344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.622614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.623245 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.624887 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.635811 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1376/2802] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:27.640208 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.650656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeceb804-a045-4b7f-ba6b-b12aa7e7c725 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.655777 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.656431 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.656733 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.657006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] PATH_INFO: `/v3/projects/af153e3c7eeb49b68e9bbe6853ac9a58/users/db96209b6d5f408490f6be1f3c35c757/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.672234 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af153e3c7eeb49b68e9bbe6853ac9a58, user_id=db96209b6d5f408490f6be1f3c35c757, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.674921 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.692351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1427/2803] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:27 2022] PUT /identity/v3/projects/af153e3c7eeb49b68e9bbe6853ac9a58/users/db96209b6d5f408490f6be1f3c35c757/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:27.696476 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.707208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cefe2c-f98c-42ab-a220-df6bd2dee5de admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.771841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a7054-fa71-4613-98ac-62106bf9dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.773378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7054-fa71-4613-98ac-62106bf9dc17 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.773378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7054-fa71-4613-98ac-62106bf9dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.773378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a7054-fa71-4613-98ac-62106bf9dc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.773747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7054-fa71-4613-98ac-62106bf9dc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.775480 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a7054-fa71-4613-98ac-62106bf9dc17 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.785397 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1377/2804] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:27.789838 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.800276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4191-ca45-4b01-84d8-c334c8a78f80 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:27.805615 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:27.806305 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.806591 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.806856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] PATH_INFO: `/v3/projects/af153e3c7eeb49b68e9bbe6853ac9a58/users/db96209b6d5f408490f6be1f3c35c757/roles/ff6687245616423c8a3e42542a544932` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.810112 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af153e3c7eeb49b68e9bbe6853ac9a58, user_id=db96209b6d5f408490f6be1f3c35c757, role_id=ff6687245616423c8a3e42542a544932)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:27.813042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:27.825036 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1428/2805] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:27 2022] PUT /identity/v3/projects/af153e3c7eeb49b68e9bbe6853ac9a58/users/db96209b6d5f408490f6be1f3c35c757/roles/ff6687245616423c8a3e42542a544932 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:27.836462 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:27.836689 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:27.836999 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:27.846145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:27.868813 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] MFA Rules not processed for user `db96209b6d5f408490f6be1f3c35c757`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:27.870121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:27.941873 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1378/2806] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:27.958865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:27.958865 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:27.981203 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:28.027726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2b222-d4af-40ec-b36b-611446908f33 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:28.031390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:28.032006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:28.032287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:28.032559 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:28.042689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:28.044896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:28.055083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1429/2807] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:28.097565 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:28.099057 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:28.112255 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e813a-97cf-4116-8033-e6750c6a800f None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:28.116301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3fd35-94de-477e-83dc-a40b72b29aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:28.116951 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3fd35-94de-477e-83dc-a40b72b29aec service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:28.117223 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3fd35-94de-477e-83dc-a40b72b29aec service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:28.117486 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3fd35-94de-477e-83dc-a40b72b29aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:28.177028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3fd35-94de-477e-83dc-a40b72b29aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:28.178537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3fd35-94de-477e-83dc-a40b72b29aec service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:28.187997 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1379/2808] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:31.138940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:31.204528 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84e0f6-b1ff-4478-afed-d26c5c324601 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:31.209109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:31.209745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:31.210018 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:31.210315 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] PATH_INFO: `/v3/users/acc809ce900647e89bc5f01cde03ec39` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:31.211430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc809ce900647e89bc5f01cde03ec39)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:31.213402 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:31.265485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc809ce900647e89bc5f01cde03ec39'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.277373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc809ce900647e89bc5f01cde03ec39'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.278041 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc809ce900647e89bc5f01cde03ec39'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.278668 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc809ce900647e89bc5f01cde03ec39'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.286082 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc809ce900647e89bc5f01cde03ec39'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.305416 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1430/2809] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:31 2022] DELETE /identity/v3/users/acc809ce900647e89bc5f01cde03ec39 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:31.311072 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:31.311947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:31.311947 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:31.335720 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:31.336998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:31.407697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1380/2810] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:31.418318 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:31.427088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:31.481837 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:31.500100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee7387-20f3-4951-a73f-6edd23fad940 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:31.504730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:31.504923 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:31.505122 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:31.505389 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:31.515538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:31.517120 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:31.527383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1431/2811] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:31.856912 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:31.858494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:31.873840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787d21f-155d-4bb3-8050-b96e93406ea6 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:31.885583 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:31.886330 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:31.886677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:31.887013 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] PATH_INFO: `/v3/projects/e4fccb1cbe4f4340bb88b3792dff9c5d` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:31.888405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4fccb1cbe4f4340bb88b3792dff9c5d)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:31.893173 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:31.918009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:31.942857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4fccb1cbe4f4340bb88b3792dff9c5d', 'request_id': 'req-b908105d-6b1c-408a-89c8-0d2b6f484672'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.949273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4fccb1cbe4f4340bb88b3792dff9c5d', 'request_id': 'req-b908105d-6b1c-408a-89c8-0d2b6f484672'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.957665 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4fccb1cbe4f4340bb88b3792dff9c5d', 'request_id': 'req-b908105d-6b1c-408a-89c8-0d2b6f484672'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.972441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] The token cache is being invalidate because project e4fccb1cbe4f4340bb88b3792dff9c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:31.972838 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.973612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:31.975164 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1381/2812] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:31 2022] DELETE /identity/v3/projects/e4fccb1cbe4f4340bb88b3792dff9c5d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:31.981818 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:31.991682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15d9ff-ea5a-4c09-8089-463761224d56 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:32.048683 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:32.049324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:32.049604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:32.049877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] PATH_INFO: `/v3/users/313f88c64a5d410aa330f7f752dc4afb` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:32.051019 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=313f88c64a5d410aa330f7f752dc4afb)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:32.052987 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:32.101886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '313f88c64a5d410aa330f7f752dc4afb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.110722 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '313f88c64a5d410aa330f7f752dc4afb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.111377 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '313f88c64a5d410aa330f7f752dc4afb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.111995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '313f88c64a5d410aa330f7f752dc4afb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.119118 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '313f88c64a5d410aa330f7f752dc4afb'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.137508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1432/2813] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:31 2022] DELETE /identity/v3/users/313f88c64a5d410aa330f7f752dc4afb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:32.432775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:32.434787 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:32.449371 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908105d-6b1c-408a-89c8-0d2b6f484672 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:32.515755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:32.516389 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:32.516697 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:32.516967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] PATH_INFO: `/v3/projects/0e9563d5f3f1476dbad7f8c3e1fbc448` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:32.518078 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9563d5f3f1476dbad7f8c3e1fbc448)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:32.519974 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:32.566104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9563d5f3f1476dbad7f8c3e1fbc448', 'request_id': 'req-80ad2a9e-0396-46cb-a54f-e1ae456556c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.572362 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9563d5f3f1476dbad7f8c3e1fbc448', 'request_id': 'req-80ad2a9e-0396-46cb-a54f-e1ae456556c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.581457 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9563d5f3f1476dbad7f8c3e1fbc448', 'request_id': 'req-80ad2a9e-0396-46cb-a54f-e1ae456556c1'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.592128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] The token cache is being invalidate because project 0e9563d5f3f1476dbad7f8c3e1fbc448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:32.592405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.593083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.594568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1382/2814] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:32 2022] DELETE /identity/v3/projects/0e9563d5f3f1476dbad7f8c3e1fbc448 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:32.598688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:32.600275 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:32.613724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7ee23-724f-4214-812c-478690cda454 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:32.677219 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:32.677773 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:32.678051 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:32.678326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] PATH_INFO: `/v3/users/db96209b6d5f408490f6be1f3c35c757` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:32.679461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db96209b6d5f408490f6be1f3c35c757)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:32.681432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:32.684605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:32.731572 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db96209b6d5f408490f6be1f3c35c757'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.740627 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db96209b6d5f408490f6be1f3c35c757'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.741272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db96209b6d5f408490f6be1f3c35c757'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.741979 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db96209b6d5f408490f6be1f3c35c757'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.749269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b4f77a91-ed6d-4acc-b124-a04fbcfee727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db96209b6d5f408490f6be1f3c35c757'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:32.767348 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1433/2815] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:32 2022] DELETE /identity/v3/users/db96209b6d5f408490f6be1f3c35c757 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:33.044988 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.046992 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:33.064910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2a9e-0396-46cb-a54f-e1ae456556c1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.113528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:33.135878 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.136707 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.137042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.137370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] PATH_INFO: `/v3/projects/af153e3c7eeb49b68e9bbe6853ac9a58` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.138605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af153e3c7eeb49b68e9bbe6853ac9a58)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.140654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.191338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af153e3c7eeb49b68e9bbe6853ac9a58', 'request_id': 'req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:33.197543 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af153e3c7eeb49b68e9bbe6853ac9a58', 'request_id': 'req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:33.206041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af153e3c7eeb49b68e9bbe6853ac9a58', 'request_id': 'req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:33.216603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] The token cache is being invalidate because project af153e3c7eeb49b68e9bbe6853ac9a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:33.216860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:33.217517 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-a2f931bf-da2e-4c8a-9ad4-9e1b2d8a50e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:33.218990 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1383/2816] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:33 2022] DELETE /identity/v3/projects/af153e3c7eeb49b68e9bbe6853ac9a58 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:33.225351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.225617 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.225935 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.247042 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:33.248325 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:33.310093 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1434/2817] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:33.319864 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.320145 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.320412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.342699 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:33.343924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:33.356054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1384/2818] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:33.360761 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.371333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e4a6-865b-4cc1-9e0d-bb8fcfd08e7f None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.377691 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.378316 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.378593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.378856 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.379509 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:33.379810 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.381443 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.393847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1435/2819] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:33.398820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.408571 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f2053-83e6-4e21-bca6-437cbb3b772e None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.413923 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.414540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.414793 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.415067 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.415695 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.417740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.449704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1385/2820] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:33 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:33.454276 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.464884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c8a5-dabd-4b0d-aab0-3f326dd2e06b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.532520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.533187 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.533469 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.533739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.534386 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.536511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.560986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:33.570577 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1436/2821] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:33 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:33.571653 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.584331 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384462-c462-4cb0-b71e-f6cb21ea05ba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.589114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.589730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.590009 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.590304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.590965 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.592724 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.606620 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1386/2822] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:33.608425 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.623547 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a987bc-ffd4-4d05-bd82-3beb66a1066b admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.629801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3475de-aea5-49da-a3b8-9f5c1b63d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.630511 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3475de-aea5-49da-a3b8-9f5c1b63d4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.630791 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3475de-aea5-49da-a3b8-9f5c1b63d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.631079 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3475de-aea5-49da-a3b8-9f5c1b63d4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.631737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3475de-aea5-49da-a3b8-9f5c1b63d4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.633449 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3475de-aea5-49da-a3b8-9f5c1b63d4ba admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.644841 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1437/2823] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:33.649454 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.661443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b3aa7-0458-475c-b1d9-034629d6846b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.666751 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.667482 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.667783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.668040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] PATH_INFO: `/v3/projects/f9a82cf8dc7545129be8b3053fff055f/users/2a34fe2bfdd841b7af97ec56c5b3605d/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.698930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a82cf8dc7545129be8b3053fff055f, user_id=2a34fe2bfdd841b7af97ec56c5b3605d, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.701647 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.716132 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1387/2824] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:33 2022] PUT /identity/v3/projects/f9a82cf8dc7545129be8b3053fff055f/users/2a34fe2bfdd841b7af97ec56c5b3605d/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:33.727280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.727570 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.727843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.758309 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] MFA Rules not processed for user `2a34fe2bfdd841b7af97ec56c5b3605d`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:33.759430 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:33.830479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1438/2825] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:33.842310 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:33.844200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:33.920028 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850a5d0-a5a3-4f59-95ed-a8c06e0f18cb admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:33.924339 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a011-08f7-458b-9b56-f6b93b99638c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:33.924993 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a011-08f7-458b-9b56-f6b93b99638c service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:33.925398 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a011-08f7-458b-9b56-f6b93b99638c service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:33.925666 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a011-08f7-458b-9b56-f6b93b99638c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:33.937297 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a011-08f7-458b-9b56-f6b93b99638c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:33.939064 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a011-08f7-458b-9b56-f6b93b99638c service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:33.950220 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1388/2826] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:33.988804 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:34.089383 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadb50c-7826-4258-b985-cfdcececcdad None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:34.095438 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:34.096271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.096825 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.097115 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] PATH_INFO: `/v3/users/2a34fe2bfdd841b7af97ec56c5b3605d` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.098424 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a34fe2bfdd841b7af97ec56c5b3605d)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:34.100388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:34.153347 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a34fe2bfdd841b7af97ec56c5b3605d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.161766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a34fe2bfdd841b7af97ec56c5b3605d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.162654 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a34fe2bfdd841b7af97ec56c5b3605d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.163326 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a34fe2bfdd841b7af97ec56c5b3605d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.170737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a34fe2bfdd841b7af97ec56c5b3605d'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.184741 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:34.193940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1439/2827] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:33 2022] DELETE /identity/v3/users/2a34fe2bfdd841b7af97ec56c5b3605d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:34.198303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.198590 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.198875 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.219494 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:34.221120 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:34.225370 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:34.289118 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1389/2828] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:34.298886 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:34.300759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:34.362770 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19300834-5003-44dc-9c6d-185b1cfbd542 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:34.367144 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b3cd8-fef9-4344-b570-26e2f517aabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:34.368457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3cd8-fef9-4344-b570-26e2f517aabe service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.368887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3cd8-fef9-4344-b570-26e2f517aabe service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.369302 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b3cd8-fef9-4344-b570-26e2f517aabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.381100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b3cd8-fef9-4344-b570-26e2f517aabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:34.382506 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b3cd8-fef9-4344-b570-26e2f517aabe service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:34.392293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1440/2829] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:34.702012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:34.703592 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:34.720574 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2d3a-47ba-4080-8461-68ea098f25de None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:34.725361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:34.725989 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.726259 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.726523 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] PATH_INFO: `/v3/projects/f9a82cf8dc7545129be8b3053fff055f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.727669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a82cf8dc7545129be8b3053fff055f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:34.729602 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:34.778193 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a82cf8dc7545129be8b3053fff055f', 'request_id': 'req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.784471 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a82cf8dc7545129be8b3053fff055f', 'request_id': 'req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.793796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a82cf8dc7545129be8b3053fff055f', 'request_id': 'req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.804744 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] The token cache is being invalidate because project f9a82cf8dc7545129be8b3053fff055f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:34.805032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.805755 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-12a4ddc4-f4fb-420e-9c8f-32fcad77bceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.807291 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1390/2830] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:34 2022] DELETE /identity/v3/projects/f9a82cf8dc7545129be8b3053fff055f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:34.812736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.813255 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.813345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.833984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:34.835323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:34.909544 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1441/2831] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:34.917532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.917928 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.918200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.939712 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:34.941016 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:34.949803 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1391/2832] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:34.954363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:34.966226 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc4dd3-90df-4071-b665-22004b57d685 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:34.971598 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:34.972272 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.972551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.972855 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.973518 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:34.973821 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:34.975464 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:34.987707 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1442/2833] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:34.992353 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.002996 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfeba0-1b84-473f-a2d3-18528f283e65 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.008657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.009303 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.009573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.009830 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.010455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.012392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.042562 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1392/2834] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:34 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:35.047271 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.057926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1329da0-7d4c-48e4-89f1-abb3540db714 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.121553 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.122342 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.122642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.122976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.123681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.125665 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.163889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1443/2835] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:35.168767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.179410 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251a49c-849e-4083-b7ee-6b4a5d138dcc admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.184149 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.184758 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.185021 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.185285 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.185961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.187558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.197458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1393/2836] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:35.201337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.211760 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f385a-fcbd-44b6-a1af-6f6dc0811995 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.216889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e40858-3c30-4baf-aebc-b286ba3c1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.217576 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40858-3c30-4baf-aebc-b286ba3c1ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.217852 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40858-3c30-4baf-aebc-b286ba3c1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.218121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40858-3c30-4baf-aebc-b286ba3c1ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.218794 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e40858-3c30-4baf-aebc-b286ba3c1ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.220376 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e40858-3c30-4baf-aebc-b286ba3c1ac1 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.231632 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1444/2837] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:35.235902 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.246270 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051d34-e1fe-4ddc-9ec3-859291c4c301 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.251998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.252654 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.252940 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.253210 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] PATH_INFO: `/v3/projects/eabe65c496714c7da03e0eff96d4d928/users/0ed4541a1c9b49a08cbeca60eef3186f/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.270384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eabe65c496714c7da03e0eff96d4d928, user_id=0ed4541a1c9b49a08cbeca60eef3186f, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.273093 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.288007 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1394/2838] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:35 2022] PUT /identity/v3/projects/eabe65c496714c7da03e0eff96d4d928/users/0ed4541a1c9b49a08cbeca60eef3186f/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:35.360932 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9a272-af28-4104-bf57-430d32251b7f None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.361713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9a272-af28-4104-bf57-430d32251b7f None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.361713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9a272-af28-4104-bf57-430d32251b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.371269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:35.397192 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f3f9a272-af28-4104-bf57-430d32251b7f None None] MFA Rules not processed for user `0ed4541a1c9b49a08cbeca60eef3186f`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:35.398479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f3f9a272-af28-4104-bf57-430d32251b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.467749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1445/2839] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:35.479662 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.481603 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.515003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.515293 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.515551 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.519917 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:35.536497 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:35.537757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.547087 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562e553-81f0-4065-901a-f5849104480b admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.550710 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.551321 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.551595 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.551860 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.560368 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.561884 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.572816 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1395/2840] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:35.596541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.597889 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1446/2841] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:35.610479 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.612468 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.674441 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe76687-076a-4225-8430-063d7ec60412 service cinder] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.679564 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.680225 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.680501 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.680804 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] PATH_INFO: `/v3/users/0ed4541a1c9b49a08cbeca60eef3186f` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.681967 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed4541a1c9b49a08cbeca60eef3186f)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.683929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.689637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb71866-308e-4618-9dd8-dd8493f63e55 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.694716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8793b-7914-465f-837a-74732654440f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.695327 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8793b-7914-465f-837a-74732654440f service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.695604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8793b-7914-465f-837a-74732654440f service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.695874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8793b-7914-465f-837a-74732654440f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.704045 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8793b-7914-465f-837a-74732654440f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.705671 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8793b-7914-465f-837a-74732654440f service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.714406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1447/2842] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:05:35.734119 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed4541a1c9b49a08cbeca60eef3186f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.746272 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed4541a1c9b49a08cbeca60eef3186f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.747481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed4541a1c9b49a08cbeca60eef3186f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.748206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed4541a1c9b49a08cbeca60eef3186f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.757318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed4541a1c9b49a08cbeca60eef3186f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.776800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1396/2843] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:35 2022] DELETE /identity/v3/users/0ed4541a1c9b49a08cbeca60eef3186f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:35.781833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.782168 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.782461 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.807694 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:35.808937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.834422 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:35.870953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1448/2844] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:35.881301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.882770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.939522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdb0d6-55ef-4f7b-a341-20216f1e78d3 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.943542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f44d2-aaf6-4767-a798-98d2c911b815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.944150 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f44d2-aaf6-4767-a798-98d2c911b815 service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.944426 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f44d2-aaf6-4767-a798-98d2c911b815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.944733 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f44d2-aaf6-4767-a798-98d2c911b815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.951282 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:35.955405 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f44d2-aaf6-4767-a798-98d2c911b815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.957350 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f44d2-aaf6-4767-a798-98d2c911b815 service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.968029 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1397/2845] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:36.262599 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.264434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.265141 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.265617 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.265892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.284364 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ef9d7-9e46-4747-abf6-ce10936eebca None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.286128 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.287338 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.297359 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.298059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.298337 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.298612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] PATH_INFO: `/v3/projects/eabe65c496714c7da03e0eff96d4d928` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.299829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eabe65c496714c7da03e0eff96d4d928)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.301986 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.347032 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1398/2846] 10.222.0.65 () {58 vars in 967 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:36.350713 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eabe65c496714c7da03e0eff96d4d928', 'request_id': 'req-b00c6c9e-b44c-40e3-8386-f93476549433'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:36.357274 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eabe65c496714c7da03e0eff96d4d928', 'request_id': 'req-b00c6c9e-b44c-40e3-8386-f93476549433'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:36.361625 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.363309 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.366373 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eabe65c496714c7da03e0eff96d4d928', 'request_id': 'req-b00c6c9e-b44c-40e3-8386-f93476549433'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:36.377391 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] The token cache is being invalidate because project eabe65c496714c7da03e0eff96d4d928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:36.377679 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:36.378324 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-b00c6c9e-b44c-40e3-8386-f93476549433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:36.379823 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1449/2847] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:36 2022] DELETE /identity/v3/projects/eabe65c496714c7da03e0eff96d4d928 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:36.384486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f8be-c5b8-47e6-8fbf-928a1d8fb06a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.384877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f8be-c5b8-47e6-8fbf-928a1d8fb06a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.385176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7f8be-c5b8-47e6-8fbf-928a1d8fb06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.405188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-6ac7f8be-c5b8-47e6-8fbf-928a1d8fb06a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.406466 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-6ac7f8be-c5b8-47e6-8fbf-928a1d8fb06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.435125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cb601-3675-4e63-8067-433e95ab8318 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.467401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1450/2848] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:36.475068 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.475542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.475812 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.496527 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.497767 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.503104 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.503779 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.504061 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.504361 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.506043 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1451/2849] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:36.508806 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.510183 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.519251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76cc8b-b0a4-470f-853f-bbc8d0f88eef None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.523971 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.524557 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.524874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.525150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.525788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:36.526087 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.527661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.539700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1452/2850] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:36.543788 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.550823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=100 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:36.553740 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd86b77-8131-4c1e-aca2-02a928f2b270 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.558531 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.559129 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.559414 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.559682 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.560304 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.562300 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.567929 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.569585 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.579121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1399/2851] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:05:36.597116 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1453/2852] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:36.600521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.611682 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc354193-0c74-4383-98b5-08e3e62c8f6c service swift] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.677825 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.678447 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.678727 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.678995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.679627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.681713 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.716250 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1400/2853] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:36.717257 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.728256 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af1c47-670b-4697-accc-f7bd9f30f232 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.733121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.733727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.734006 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.734406 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.735053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.736684 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.742926 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:36.749053 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1454/2854] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:36.753828 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.770075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0762d20-58f6-4e90-89fe-9b9cdc263742 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.774973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b80b1-46c5-4584-b3bb-2599346797dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.775818 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b80b1-46c5-4584-b3bb-2599346797dd admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.776094 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b80b1-46c5-4584-b3bb-2599346797dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.776360 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b80b1-46c5-4584-b3bb-2599346797dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.777042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b80b1-46c5-4584-b3bb-2599346797dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.778726 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b80b1-46c5-4584-b3bb-2599346797dd admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.789040 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1401/2855] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:36.793381 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.804700 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b49cce-bc64-4b4c-9fe3-420f41e2a924 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.809815 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3eeef-1015-439e-95aa-9721525b31b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.810602 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3eeef-1015-439e-95aa-9721525b31b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.810998 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3eeef-1015-439e-95aa-9721525b31b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.811471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3eeef-1015-439e-95aa-9721525b31b7 admin admin] PATH_INFO: `/v3/projects/823f1ee97d304410987b8bdb9e43a347/users/193232d1421648fb98e6ffa5d825d104/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.822042 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.822329 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.822637 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.828071 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3eeef-1015-439e-95aa-9721525b31b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823f1ee97d304410987b8bdb9e43a347, user_id=193232d1421648fb98e6ffa5d825d104, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.830745 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3eeef-1015-439e-95aa-9721525b31b7 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.843262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.844521 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.845521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1455/2856] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:36 2022] PUT /identity/v3/projects/823f1ee97d304410987b8bdb9e43a347/users/193232d1421648fb98e6ffa5d825d104/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:05:36.856096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.856321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.856642 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.887827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] MFA Rules not processed for user `193232d1421648fb98e6ffa5d825d104`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.889201 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.902458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1402/2857] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:36.915380 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.917112 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.954031 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1456/2858] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:36.967221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.968596 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.986342 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48682-b9c6-4391-b749-236357e8d902 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.992295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490cdf7f-ebad-466e-91cb-72e06a81251b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.992964 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cdf7f-ebad-466e-91cb-72e06a81251b service swift] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.993263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cdf7f-ebad-466e-91cb-72e06a81251b service swift] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.993535 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cdf7f-ebad-466e-91cb-72e06a81251b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:37.000525 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:37.003378 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cdf7f-ebad-466e-91cb-72e06a81251b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:37.005553 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490cdf7f-ebad-466e-91cb-72e06a81251b service swift] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:37.015513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1403/2859] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:05:37.026857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb81aa2-3998-4d2b-956c-425e7189b7db None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:37.031231 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:37.032369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:37.032369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:37.032550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:37.042369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:37.043901 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:37.053737 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1457/2860] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:05:37.348237 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:37.348522 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:37.348823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:37.371125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:37.371125 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:37.378068 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1404/2861] 10.222.0.65 () {58 vars in 967 bytes} [Tue Sep 13 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:37.390620 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:37.402772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aabbe8e-2541-4ba2-9b60-a8fe9feb0a52 service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:37.407908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2e4ac-1be0-48dd-847c-37879ba451e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:37.408519 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e4ac-1be0-48dd-847c-37879ba451e1 service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:37.408829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e4ac-1be0-48dd-847c-37879ba451e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:37.409105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2e4ac-1be0-48dd-847c-37879ba451e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:37.417212 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2e4ac-1be0-48dd-847c-37879ba451e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:37.418785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2e4ac-1be0-48dd-847c-37879ba451e1 service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:37.426843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1458/2862] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:05:39.566146 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:39.568507 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:39.645450 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eaf69-175e-41aa-82f9-6bd3a7f58092 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:39.651276 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:39.651922 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:39.652200 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:39.652468 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] PATH_INFO: `/v3/users/db77636a0446485ba57937949899d3be` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:39.653669 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db77636a0446485ba57937949899d3be)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:39.655735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:39.703503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db77636a0446485ba57937949899d3be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:39.711980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db77636a0446485ba57937949899d3be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:39.712657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db77636a0446485ba57937949899d3be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:39.713300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db77636a0446485ba57937949899d3be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:39.720455 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db77636a0446485ba57937949899d3be'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:39.737316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1405/2863] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:39 2022] DELETE /identity/v3/users/db77636a0446485ba57937949899d3be => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:39.741868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:39.742370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:39.742370 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:39.761991 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:39.763178 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:39.812894 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:39.826543 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1459/2864] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:39.836148 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:39.837557 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:39.894845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90638b-f1db-400a-b096-de0c7bb73652 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:39.899184 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc0dcf-f606-405f-948f-bf3157130cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:39.899778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc0dcf-f606-405f-948f-bf3157130cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:39.900047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc0dcf-f606-405f-948f-bf3157130cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:39.900307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc0dcf-f606-405f-948f-bf3157130cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:39.909899 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc0dcf-f606-405f-948f-bf3157130cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:39.911349 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc0dcf-f606-405f-948f-bf3157130cfd service neutron] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:39.921428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1406/2865] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:40.100476 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.102358 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:40.116396 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29091d-f7a0-4276-8d52-3b20fab3e435 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.121980 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.122637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.122937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.123217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] PATH_INFO: `/v3/projects/9f2a87ffa3b04a909e26d295272bcab5` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.124409 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2a87ffa3b04a909e26d295272bcab5)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.126384 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.185949 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2a87ffa3b04a909e26d295272bcab5', 'request_id': 'req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:40.193365 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2a87ffa3b04a909e26d295272bcab5', 'request_id': 'req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:40.201964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2a87ffa3b04a909e26d295272bcab5', 'request_id': 'req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:40.213075 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] The token cache is being invalidate because project 9f2a87ffa3b04a909e26d295272bcab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81563) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:40.213484 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:40.214124 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-01e9ebd3-d6ea-469f-b92b-8e2bedb5cba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:40.215799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1460/2866] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:40 2022] DELETE /identity/v3/projects/9f2a87ffa3b04a909e26d295272bcab5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:40.220958 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.221246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.221520 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.240704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:40.241901 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:40.247304 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:40.304763 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1407/2867] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:40.312811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.313096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.313397 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.335732 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:40.336992 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:40.345049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1461/2868] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:40.349648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.364650 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8afd0c-988f-4f11-afd1-ba354b38825c None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.370298 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.370925 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.371209 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.371513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.372179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81564) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:40.372540 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.374528 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.390206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1408/2869] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:05:40.395626 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.408269 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918236bb-81a5-4189-8894-072f98f4e06a None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.414135 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.414785 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.415131 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.415401 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.416034 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.418017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.447996 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1462/2870] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:40 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:40.452747 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.463217 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bec692-6fcc-4b8f-ae35-b558c5be08f9 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.524980 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.525606 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.525877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.526147 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.526782 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.528935 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.552401 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1409/2871] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:40 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:40.556678 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.567352 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a80121-9210-417f-8040-3fec183974e8 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.573050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.573656 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.573953 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.574207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.574969 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.576884 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.586995 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1463/2872] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:40.590943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.601144 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a66b93-6b4d-4d00-b71b-6632d0feb8a1 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.606529 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bcb34-4fdc-48bf-9610-94ca58f1e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.607153 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bcb34-4fdc-48bf-9610-94ca58f1e8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.607425 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bcb34-4fdc-48bf-9610-94ca58f1e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.607775 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bcb34-4fdc-48bf-9610-94ca58f1e8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.608412 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bcb34-4fdc-48bf-9610-94ca58f1e8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.610048 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bcb34-4fdc-48bf-9610-94ca58f1e8f2 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.621163 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1410/2873] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:40.625349 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.635898 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd4e33-c8a6-4dd7-ba82-59ab893c1db2 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.641361 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.642007 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.642280 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.642521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] PATH_INFO: `/v3/projects/5817b81c97f64b378c8a7ce7410e2913/users/8c87691de2d04cfba27415cea63cfbba/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.656896 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5817b81c97f64b378c8a7ce7410e2913, user_id=8c87691de2d04cfba27415cea63cfbba, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.659542 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.674759 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1464/2874] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:40 2022] PUT /identity/v3/projects/5817b81c97f64b378c8a7ce7410e2913/users/8c87691de2d04cfba27415cea63cfbba/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:40.679833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca145f-db21-41f6-bfd7-5e74e555a834 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.680116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca145f-db21-41f6-bfd7-5e74e555a834 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.680418 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca145f-db21-41f6-bfd7-5e74e555a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.701834 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-d4ca145f-db21-41f6-bfd7-5e74e555a834 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:40.703036 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d4ca145f-db21-41f6-bfd7-5e74e555a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:40.766318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1411/2875] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:40.779669 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:40.782059 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:40.847022 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433e687-00cc-4c52-9370-08540de6fe28 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:40.852321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:40.852972 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:40.853248 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:40.853524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:40.865175 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:40.866616 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:40.876882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1465/2876] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:41.608559 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a951c-5cc7-4c1b-ab4e-dee13e271987 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:41.613888 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a951c-5cc7-4c1b-ab4e-dee13e271987 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:41.614320 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a951c-5cc7-4c1b-ab4e-dee13e271987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:41.669487 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-942a951c-5cc7-4c1b-ab4e-dee13e271987 None None] MFA Rules not processed for user `8c87691de2d04cfba27415cea63cfbba`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:41.670778 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-942a951c-5cc7-4c1b-ab4e-dee13e271987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:41.684224 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:41.760379 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1412/2877] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:41.771757 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:41.773301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:41.794556 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:41.833346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039f94-9ea2-4b2d-9f9c-6213c4fea2de service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:41.837150 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:41.837952 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:41.838242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:41.838550 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:41.847711 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:41.849200 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:41.858413 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1466/2878] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:43.250708 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f717fa-0e6d-46b6-8029-547a5a71e435 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:43.251257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f717fa-0e6d-46b6-8029-547a5a71e435 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:43.251257 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f717fa-0e6d-46b6-8029-547a5a71e435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:43.271231 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-44f717fa-0e6d-46b6-8029-547a5a71e435 None None] MFA Rules not processed for user `8c87691de2d04cfba27415cea63cfbba`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:43.272428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-44f717fa-0e6d-46b6-8029-547a5a71e435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:43.279267 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1413/2879] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:48.798184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:48.800432 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:48.819712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26515ee8-c5b5-48ad-8ce0-72c5207b4d9a service cinder] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:48.825538 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:48.826157 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:48.826428 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:48.826686 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] PATH_INFO: `/v3/users/1645e333a9da4b5d94eb45b06dc1adf8` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:48.828072 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1645e333a9da4b5d94eb45b06dc1adf8)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:48.830048 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:48.879730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1645e333a9da4b5d94eb45b06dc1adf8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:48.887170 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1645e333a9da4b5d94eb45b06dc1adf8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:48.887984 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1645e333a9da4b5d94eb45b06dc1adf8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:48.888630 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1645e333a9da4b5d94eb45b06dc1adf8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:48.895749 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1645e333a9da4b5d94eb45b06dc1adf8'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:48.912927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1467/2880] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:48 2022] DELETE /identity/v3/users/1645e333a9da4b5d94eb45b06dc1adf8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:48.917531 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:48.918054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:48.918054 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:48.937430 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:48.938800 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:49.002497 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1414/2881] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:49.012421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:49.014016 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:49.093736 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced75b-5276-4e50-bd94-7c11cc8cdf89 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:49.097876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8c3f0-f5e0-420a-8f5a-07597d888e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:49.098494 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c3f0-f5e0-420a-8f5a-07597d888e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.098780 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c3f0-f5e0-420a-8f5a-07597d888e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.099050 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8c3f0-f5e0-420a-8f5a-07597d888e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.109049 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c3f0-f5e0-420a-8f5a-07597d888e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:49.110563 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8c3f0-f5e0-420a-8f5a-07597d888e91 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:49.123814 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1468/2882] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:49.436742 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:49.439696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:49.463358 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba94959-048f-4fe7-9179-98fbca0d746b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:49.468977 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:49.469656 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.469942 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.470273 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] PATH_INFO: `/v3/projects/08b52f024f0a485c80a6d6397af33e8b` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.471465 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b52f024f0a485c80a6d6397af33e8b)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:49.473627 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:49.532178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b52f024f0a485c80a6d6397af33e8b', 'request_id': 'req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:49.538604 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b52f024f0a485c80a6d6397af33e8b', 'request_id': 'req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:49.546948 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b52f024f0a485c80a6d6397af33e8b', 'request_id': 'req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:49.559039 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] The token cache is being invalidate because project 08b52f024f0a485c80a6d6397af33e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:49.559357 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:49.559909 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-2c95b6c6-593a-4ca0-b96d-c59e8dc4dae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:49.564657 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1415/2883] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:49 2022] DELETE /identity/v3/projects/08b52f024f0a485c80a6d6397af33e8b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:49.567100 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.567387 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.567661 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.597951 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:49.599184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:49.630704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:49.660323 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1469/2884] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:49.668648 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.668930 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.669201 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.689663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:49.690950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:49.699014 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1416/2885] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:49.703647 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:49.720290 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af1e2f-84c3-4aa6-8042-c27b7dceb546 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:49.727427 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:49.728113 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.728586 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.729121 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.730308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81563) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:49.730829 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:49.732521 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:49.748674 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1470/2886] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:05:49.753084 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:49.777808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04134dfc-f3c1-42f0-9c3a-8cb2e5aae937 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:49.782845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:49.783810 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.784121 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.784443 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] PATH_INFO: `/v3/projects` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.785385 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:49.787630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:49.805199 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:49.820817 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1417/2887] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:49 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:49.824702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:49.835621 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7fbdd-736d-4030-b1e0-561aff101b44 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:49.914772 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:49.915565 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.916044 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.916311 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] PATH_INFO: `/v3/users` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.917513 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:49.919524 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:49.949817 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1471/2888] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:49 2022] POST /identity/v3/users => generated 295 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:05:49.951740 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:49.963102 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f23a0-c617-4bee-858f-d206180fb672 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:49.970408 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:49.971265 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:49.971936 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:49.972491 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] PATH_INFO: `/v3/roles` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:49.973420 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:49.975317 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:49.986735 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1418/2889] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:49.996997 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:50.013913 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b715b31-c87a-4709-8d98-c8f633ab00fb admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:50.018887 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabbe9c-ecfd-4dd1-9cad-251ecc0e6685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:50.019500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabbe9c-ecfd-4dd1-9cad-251ecc0e6685 admin admin] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:50.019802 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabbe9c-ecfd-4dd1-9cad-251ecc0e6685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:50.020069 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabbe9c-ecfd-4dd1-9cad-251ecc0e6685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:50.020756 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabbe9c-ecfd-4dd1-9cad-251ecc0e6685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:50.022345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabbe9c-ecfd-4dd1-9cad-251ecc0e6685 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:50.036410 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1472/2890] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:50.044280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:50.061591 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802a16-ce9e-4331-8cd2-7fe66550edba admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:50.070730 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:50.071683 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:50.071976 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:50.072290 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] PATH_INFO: `/v3/projects/4da84c0642e94ab492484a8cc128f896/users/db8ac6efb4614e58be975655b6941c0f/roles/179c8295939541c3816444f2b7a59ae4` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:50.097299 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da84c0642e94ab492484a8cc128f896, user_id=db8ac6efb4614e58be975655b6941c0f, role_id=179c8295939541c3816444f2b7a59ae4)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:50.099961 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:50.116213 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1419/2891] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:50 2022] PUT /identity/v3/projects/4da84c0642e94ab492484a8cc128f896/users/db8ac6efb4614e58be975655b6941c0f/roles/179c8295939541c3816444f2b7a59ae4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:50.127328 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:50.127612 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:50.127877 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:50.157644 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] MFA Rules not processed for user `db8ac6efb4614e58be975655b6941c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:50.158854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:50.228552 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1473/2892] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:50.242077 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:50.244187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:50.307783 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbcad0-5374-4eb7-9cf0-ba3a495dcf2e admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:50.311687 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2ba0-26ce-4b8a-a0c5-f2b9f6b8b072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd81e355fe7294414a24428411ade0019', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:50.312295 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2ba0-26ce-4b8a-a0c5-f2b9f6b8b072 service cinder] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:50.312573 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2ba0-26ce-4b8a-a0c5-f2b9f6b8b072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:50.312945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2ba0-26ce-4b8a-a0c5-f2b9f6b8b072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:50.321612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae2ba0-26ce-4b8a-a0c5-f2b9f6b8b072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:50.323045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae2ba0-26ce-4b8a-a0c5-f2b9f6b8b072 service cinder] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:50.332548 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1420/2893] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:00.224643 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:00.327983 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:00.571637 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:00.686388 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3649fa1-790f-409b-8a70-646ef3f90da9 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:00.691583 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:00.692242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:00.692520 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:00.692845 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] PATH_INFO: `/v3/users/db8ac6efb4614e58be975655b6941c0f` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:00.694038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8ac6efb4614e58be975655b6941c0f)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:00.696117 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:00.748702 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8ac6efb4614e58be975655b6941c0f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:00.758485 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8ac6efb4614e58be975655b6941c0f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:00.759099 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8ac6efb4614e58be975655b6941c0f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:00.759689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8ac6efb4614e58be975655b6941c0f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:00.767268 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8ac6efb4614e58be975655b6941c0f'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:00.785753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1474/2894] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:06:00 2022] DELETE /identity/v3/users/db8ac6efb4614e58be975655b6941c0f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:00.790716 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:00.790995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:00.791262 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:00.843140 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:00.844348 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:00.904892 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1421/2895] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:00.916109 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:00.918390 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:00.966217 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:01.002689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d966a-c4ff-4138-9622-20cc8e79ec78 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:01.007481 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:01.008119 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:01.008392 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:01.008693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:01.019492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:01.020963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:01.030878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1475/2896] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:01.309759 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:01.311737 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:01.331458 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b3817-a855-4663-91f7-0c143f225741 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:01.338623 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:01.339275 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:01.339541 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:01.339814 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] PATH_INFO: `/v3/projects/4da84c0642e94ab492484a8cc128f896` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:01.341079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da84c0642e94ab492484a8cc128f896)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:01.343022 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:01.395706 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da84c0642e94ab492484a8cc128f896', 'request_id': 'req-c2688d5f-13af-4a8e-8514-5200b3234ac7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:01.402927 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da84c0642e94ab492484a8cc128f896', 'request_id': 'req-c2688d5f-13af-4a8e-8514-5200b3234ac7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:01.411848 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da84c0642e94ab492484a8cc128f896', 'request_id': 'req-c2688d5f-13af-4a8e-8514-5200b3234ac7'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:01.423771 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] The token cache is being invalidate because project 4da84c0642e94ab492484a8cc128f896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:06:01.424041 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:01.424903 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-c2688d5f-13af-4a8e-8514-5200b3234ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:01.426558 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1422/2897] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:06:01 2022] DELETE /identity/v3/projects/4da84c0642e94ab492484a8cc128f896 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:11.026199 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=16 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:11.420307 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:11.646717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:11.648330 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:11.662096 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046cc5c-71a1-45a1-8cba-2a0e81541523 service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:11.726507 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:11.727056 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:11.727331 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:11.727595 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] PATH_INFO: `/v3/users/193232d1421648fb98e6ffa5d825d104` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:11.728809 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193232d1421648fb98e6ffa5d825d104)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:11.730753 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:11.781792 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193232d1421648fb98e6ffa5d825d104'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:11.790578 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193232d1421648fb98e6ffa5d825d104'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:11.791202 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193232d1421648fb98e6ffa5d825d104'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:11.791882 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193232d1421648fb98e6ffa5d825d104'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:11.798750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193232d1421648fb98e6ffa5d825d104'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:11.816883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1476/2898] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:06:11 2022] DELETE /identity/v3/users/193232d1421648fb98e6ffa5d825d104 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:11.821568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:11.821868 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:11.822124 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:11.841622 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:11.842823 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:11.904160 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1423/2899] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:11.913916 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:11.915437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:11.975957 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a758d-eae3-4ad4-b742-f45a1a2ce329 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:11.981508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e8cd1-0c13-48c4-b975-0f6c84b8d3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:11.982055 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e8cd1-0c13-48c4-b975-0f6c84b8d3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:11.982333 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e8cd1-0c13-48c4-b975-0f6c84b8d3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:11.982604 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e8cd1-0c13-48c4-b975-0f6c84b8d3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:11.992251 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e8cd1-0c13-48c4-b975-0f6c84b8d3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:11.993727 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e8cd1-0c13-48c4-b975-0f6c84b8d3c4 service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:12.003708 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1477/2900] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:12.297877 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:12.299301 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:12.322598 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d506e-c2d4-49e4-9aa8-f113a97d61d3 None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:12.329208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:12.330110 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:12.330547 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:12.331012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] PATH_INFO: `/v3/projects/823f1ee97d304410987b8bdb9e43a347` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:12.332313 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=823f1ee97d304410987b8bdb9e43a347)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:12.334376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:12.382926 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823f1ee97d304410987b8bdb9e43a347', 'request_id': 'req-40d83f90-f70b-486b-aa99-11d839f37a7c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:12.389363 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823f1ee97d304410987b8bdb9e43a347', 'request_id': 'req-40d83f90-f70b-486b-aa99-11d839f37a7c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:12.397655 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823f1ee97d304410987b8bdb9e43a347', 'request_id': 'req-40d83f90-f70b-486b-aa99-11d839f37a7c'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:12.408315 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] The token cache is being invalidate because project 823f1ee97d304410987b8bdb9e43a347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:06:12.408696 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:12.409318 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:12.410833 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1424/2901] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:06:12 2022] DELETE /identity/v3/projects/823f1ee97d304410987b8bdb9e43a347 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:14.995454 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23c9af-6bac-4c63-af37-4ab221bb10aa None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:14.996080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23c9af-6bac-4c63-af37-4ab221bb10aa None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:14.996080 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23c9af-6bac-4c63-af37-4ab221bb10aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:15.028634 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:15.053012 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-fc23c9af-6bac-4c63-af37-4ab221bb10aa None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:15.054238 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-fc23c9af-6bac-4c63-af37-4ab221bb10aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:15.122959 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1478/2902] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:15.138464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:15.140031 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:15.233046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:15.248492 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83f90-f70b-486b-aa99-11d839f37a7c admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:15.255157 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:15.255845 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:15.256116 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:15.256384 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:15.265242 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:15.266837 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:15.276337 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1425/2903] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:18.043297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb159-21a7-4619-ba3a-7e10815fd46a None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:18.043897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb159-21a7-4619-ba3a-7e10815fd46a None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:18.043897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb159-21a7-4619-ba3a-7e10815fd46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:18.064712 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-321eb159-21a7-4619-ba3a-7e10815fd46a None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:18.065944 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-321eb159-21a7-4619-ba3a-7e10815fd46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:18.075242 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1479/2904] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:06:18.090704 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:18.092322 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:18.107995 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb79155-7cb6-4bc2-b31c-ed21cb0786b5 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:18.115026 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:18.115630 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:18.115904 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:18.116169 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:18.126178 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:18.128113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:18.137945 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1426/2905] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:21.348213 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed310d-1c32-4ca2-bb2e-32b77aecb1dc None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:21.348843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed310d-1c32-4ca2-bb2e-32b77aecb1dc None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:21.348843 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed310d-1c32-4ca2-bb2e-32b77aecb1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:21.369667 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d3ed310d-1c32-4ca2-bb2e-32b77aecb1dc None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:21.370880 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d3ed310d-1c32-4ca2-bb2e-32b77aecb1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:21.380659 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1480/2906] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:21.396481 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:21.408206 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc478a4f-4c7d-4eb0-8fd7-b8a400d5068f service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:21.415079 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:21.415674 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:21.415943 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:21.416202 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:21.424846 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:21.426527 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:21.436500 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1427/2907] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:24.451742 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07f39b-584b-49bf-9e53-2c67aa146fcd None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:24.452237 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07f39b-584b-49bf-9e53-2c67aa146fcd None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:24.452351 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd07f39b-584b-49bf-9e53-2c67aa146fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:24.472058 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-bd07f39b-584b-49bf-9e53-2c67aa146fcd None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:24.473314 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-bd07f39b-584b-49bf-9e53-2c67aa146fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:24.481287 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1481/2908] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:24.498130 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:24.510003 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509ae3e-75dd-4b52-b185-b332cc1134f1 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:24.517179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:24.517797 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:24.518050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:24.518345 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:24.526857 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:24.528444 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:24.537798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1428/2909] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:27.633784 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9b34-c4b2-45bd-8274-aacdc0e07d7c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.634297 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9b34-c4b2-45bd-8274-aacdc0e07d7c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.634399 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c9b34-c4b2-45bd-8274-aacdc0e07d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.655631 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7b8c9b34-c4b2-45bd-8274-aacdc0e07d7c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:27.656874 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7b8c9b34-c4b2-45bd-8274-aacdc0e07d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:27.665188 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1482/2910] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:27.685987 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:27.697246 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f875-9065-42da-8b81-e9793a9fb050 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:27.703319 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:27.703910 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.704187 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.704452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.712709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:27.714336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:27.723705 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1429/2911] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:30.822847 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:30.823369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:30.823369 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:30.843546 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:30.844771 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:30.853003 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1483/2912] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:30.871719 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:30.883238 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a63261-7744-4ccb-8026-4cee0259d792 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:30.889253 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede245-5d4e-4440-8974-b5471c20392c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:30.889852 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede245-5d4e-4440-8974-b5471c20392c service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:30.890129 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede245-5d4e-4440-8974-b5471c20392c service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:30.890400 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede245-5d4e-4440-8974-b5471c20392c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:30.898542 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdede245-5d4e-4440-8974-b5471c20392c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:30.900113 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdede245-5d4e-4440-8974-b5471c20392c service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:30.909336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1430/2913] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:40.838471 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=43 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:40.905263 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=38 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:41.225105 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:41.226724 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:41.325793 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab897fd-5f2d-49d7-bff0-90324bb4b12c None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:41.332005 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:41.332636 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:41.332942 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:41.333207 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:41.335306 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:41.348645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:41.350258 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:41.361411 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1484/2914] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:46.207316 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f738-4538-401d-a5a8-5cd9cbee1185 None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:46.207861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f738-4538-401d-a5a8-5cd9cbee1185 None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:46.207861 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f738-4538-401d-a5a8-5cd9cbee1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:46.237452 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-db71f738-4538-401d-a5a8-5cd9cbee1185 None None] MFA Rules not processed for user `8c87691de2d04cfba27415cea63cfbba`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:46.238645 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-db71f738-4538-401d-a5a8-5cd9cbee1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:46.310161 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1431/2915] 10.222.0.65 () {58 vars in 958 bytes} [Tue Sep 13 20:06:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:46.552750 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:46.554897 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:46.644964 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9aaf6a-ffd4-492f-a1c5-dd881a7ed36b service placement] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:46.648726 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dbd68ef35a54c45baada1c45509985c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:46.649317 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:46.649605 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:46.649871 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:46.651806 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:46.662266 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:46.663688 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:46.672650 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1485/2916] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:56.302516 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=25 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:56.668340 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=76 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:56.908428 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300281e3-0bca-4720-969e-b77102a3c2dc None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:56.908745 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300281e3-0bca-4720-969e-b77102a3c2dc None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:56.909044 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300281e3-0bca-4720-969e-b77102a3c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:56.939012 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-300281e3-0bca-4720-969e-b77102a3c2dc None None] MFA Rules not processed for user `7341e345e620445583169f35d05deddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:56.940156 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-300281e3-0bca-4720-969e-b77102a3c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:56.994532 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1432/2917] 10.222.0.65 () {58 vars in 967 bytes} [Tue Sep 13 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:57.048689 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:57.050221 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:57.130714 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5cfb-d5f8-412d-a7b8-7a6bad01349d service neutron] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:57.135963 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060c831449d541a28a826628ac472ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:57.136580 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:57.136883 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:57.137151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:57.145878 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:57.147451 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:57.155905 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1486/2918] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Sep 13 20:06:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:07:00.946921 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25840916-2291-459f-a5b1-be1a615e750b None None] REQUEST_METHOD: `POST` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:00.948663 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25840916-2291-459f-a5b1-be1a615e750b None None] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:00.949174 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25840916-2291-459f-a5b1-be1a615e750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:00.992208 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.auth.core [None req-25840916-2291-459f-a5b1-be1a615e750b None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81564) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:00.993767 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-25840916-2291-459f-a5b1-be1a615e750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:01.002091 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1433/2919] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:01.016487 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:01.028893 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5074c-0c9b-4b8b-921f-65d40738bf4b service swift] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:01.034937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cef8e-b408-40d8-be87-49398b01185b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:01.035646 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cef8e-b408-40d8-be87-49398b01185b service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:01.035927 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cef8e-b408-40d8-be87-49398b01185b service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:01.036198 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cef8e-b408-40d8-be87-49398b01185b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:01.052151 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cef8e-b408-40d8-be87-49398b01185b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:01.053782 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cef8e-b408-40d8-be87-49398b01185b service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:01.064301 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1487/2920] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:03.991568 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25840916-2291-459f-a5b1-be1a615e750b None None] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:03.993448 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-25840916-2291-459f-a5b1-be1a615e750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:04.010519 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25840916-2291-459f-a5b1-be1a615e750b None None] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:04.020162 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:04.021841 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.022240 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.022612 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] PATH_INFO: `/v3/users/101ddc6c43ba4350bd39e062701dd744` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.024108 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101ddc6c43ba4350bd39e062701dd744)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:04.026464 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.080694 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101ddc6c43ba4350bd39e062701dd744'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.091693 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101ddc6c43ba4350bd39e062701dd744'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.092347 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101ddc6c43ba4350bd39e062701dd744'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.093047 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101ddc6c43ba4350bd39e062701dd744'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.105179 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101ddc6c43ba4350bd39e062701dd744'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.125770 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1434/2921] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:03 2022] DELETE /identity/v3/users/101ddc6c43ba4350bd39e062701dd744 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:04.242730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.243225 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.243308 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.264808 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:04.266038 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:04.315053 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:04.316824 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:04.339140 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1488/2922] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:04.354346 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:04.355717 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:04.387089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7be27-6a26-449d-8d82-80ecbed03232 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:04.392050 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:04.392714 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.392994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.393264 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] PATH_INFO: `/v3/projects/528d5051cc744f09b93a1ee9435c8217` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.394375 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528d5051cc744f09b93a1ee9435c8217)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:04.396372 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.398711 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:04.446345 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e221e-9885-4910-8f84-6f34dc7b2b5e None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:04.452568 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:04.453216 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.453517 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.453801 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.460510 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528d5051cc744f09b93a1ee9435c8217', 'request_id': 'req-4c9379d1-7104-4435-b1a2-fe2763806f08'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.463176 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:04.464811 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.467045 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528d5051cc744f09b93a1ee9435c8217', 'request_id': 'req-4c9379d1-7104-4435-b1a2-fe2763806f08'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.474833 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1489/2923] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:04.475994 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528d5051cc744f09b93a1ee9435c8217', 'request_id': 'req-4c9379d1-7104-4435-b1a2-fe2763806f08'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.486794 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] The token cache is being invalidate because project 528d5051cc744f09b93a1ee9435c8217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:04.487083 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.487709 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.489508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1435/2924] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:04 2022] DELETE /identity/v3/projects/528d5051cc744f09b93a1ee9435c8217 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:04.493363 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:04.498148 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=100 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:04.504658 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622417c-a1b0-4f86-8ba6-f6765d5a46da service nova] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:04.561457 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:04.562040 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.562321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.562593 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] PATH_INFO: `/v3/users/9a848ff25e704e1f8fa1a01f9e627d6a` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.563857 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a848ff25e704e1f8fa1a01f9e627d6a)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:04.565868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.614145 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a848ff25e704e1f8fa1a01f9e627d6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.623492 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a848ff25e704e1f8fa1a01f9e627d6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.624171 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a848ff25e704e1f8fa1a01f9e627d6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.624827 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a848ff25e704e1f8fa1a01f9e627d6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.632645 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-14ba2c5b-7d74-47d3-acf2-8f33ceb38d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a848ff25e704e1f8fa1a01f9e627d6a'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.649681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1490/2925] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:04 2022] DELETE /identity/v3/users/9a848ff25e704e1f8fa1a01f9e627d6a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:07:04.827973 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:04.829776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:04.845344 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9379d1-7104-4435-b1a2-fe2763806f08 admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:04.906739 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:04.907503 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.907826 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.908117 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] PATH_INFO: `/v3/projects/12ec26d74c2f4c68808499f0633feeb9` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.909582 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ec26d74c2f4c68808499f0633feeb9)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:04.911537 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.958840 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ec26d74c2f4c68808499f0633feeb9', 'request_id': 'req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.964796 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ec26d74c2f4c68808499f0633feeb9', 'request_id': 'req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.973605 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ec26d74c2f4c68808499f0633feeb9', 'request_id': 'req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.983837 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] The token cache is being invalidate because project 12ec26d74c2f4c68808499f0633feeb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:04.984114 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.984776 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:04.986326 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1436/2926] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:04 2022] DELETE /identity/v3/projects/12ec26d74c2f4c68808499f0633feeb9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:07.337184 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491a73-eed4-49e1-acea-6e927543222e None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.337681 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491a73-eed4-49e1-acea-6e927543222e None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.337799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491a73-eed4-49e1-acea-6e927543222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.357739 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-d3491a73-eed4-49e1-acea-6e927543222e None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:07.358937 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-d3491a73-eed4-49e1-acea-6e927543222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:07.428077 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1491/2927] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:07.443421 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:07.445107 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:07.472392 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:07.524046 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e04e9c-dd56-400b-8ffe-e6b46de2c80a admin admin] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:07.530772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:07.531376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:07.531649 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:07.531985 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:07.540506 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:07.542126 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:07.551589 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1437/2928] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:10.521876 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9eb5c-14d9-44aa-8084-b5747725489c None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:10.522421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9eb5c-14d9-44aa-8084-b5747725489c None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:10.522421 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9eb5c-14d9-44aa-8084-b5747725489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:10.543434 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-54c9eb5c-14d9-44aa-8084-b5747725489c None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:10.544704 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-54c9eb5c-14d9-44aa-8084-b5747725489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:10.553716 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1492/2929] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:10.571216 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:10.572924 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.fernet_utils [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81564) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:10.587772 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3517d7-c439-4c1d-9d6d-468f26b77d5e service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:10.594533 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:10.595131 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:10.595407 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:10.595677 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:10.604998 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:10.606546 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:10.616011 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1438/2930] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:13.714334 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] REQUEST_METHOD: `POST` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:13.714868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:13.714868 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:13.738017 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.auth.core [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] MFA Rules not processed for user `bee6ddf3af8f44e6a826bfe586fc1067`. Rule list: `[]` (Enabled: `True`). {{(pid=81563) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:13.739223 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:13.748500 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1493/2931] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:13.766411 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:13.778376 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc95640-96f1-48c5-80f1-ef09ea7cd5fd service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:13.784820 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a919420853a4ac8b461e303fc993429', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:13.785508 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] REQUEST_METHOD: `GET` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:13.785788 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:13.786103 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:13.794644 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:13.796227 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:13.805785 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1439/2932] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:23.732940 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:23.801694 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=36 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:41.974236 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:41.975730 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:41.989978 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c9088-eb0f-4c64-9d25-fd2425dd9b60 None None] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:41.994976 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:41.995575 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:41.995854 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:41.996127 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] PATH_INFO: `/v3/users/8c87691de2d04cfba27415cea63cfbba` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:41.997277 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c87691de2d04cfba27415cea63cfbba)` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:41.999267 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:42.049123 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c87691de2d04cfba27415cea63cfbba'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.058088 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c87691de2d04cfba27415cea63cfbba'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.058989 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c87691de2d04cfba27415cea63cfbba'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.060024 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c87691de2d04cfba27415cea63cfbba'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.068321 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.notifications [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c87691de2d04cfba27415cea63cfbba'} {{(pid=81563) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.086799 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1494/2933] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Sep 13 20:07:41 2022] DELETE /identity/v3/users/8c87691de2d04cfba27415cea63cfbba => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:42.279280 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] Authenticating user token {{(pid=81564) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:42.290089 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c71587-6214-4172-bfd5-18fc52fa18b3 service nova] Validating token access rules against request {{(pid=81564) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:42.346614 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee6ddf3af8f44e6a826bfe586fc1067', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23d0b7aaf7cd4805b724aaf6b19401b4', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81564) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:42.347249 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:42.347545 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] SCRIPT_NAME: `/identity` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:42.347808 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] PATH_INFO: `/v3/projects/5817b81c97f64b378c8a7ce7410e2913` {{(pid=81564) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:42.349075 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5817b81c97f64b378c8a7ce7410e2913)` {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:42.350950 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] RBAC: Authorization granted {{(pid=81564) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:42.396033 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5817b81c97f64b378c8a7ce7410e2913', 'request_id': 'req-40fd9576-b660-4370-afd7-009cfc58635f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.402798 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5817b81c97f64b378c8a7ce7410e2913', 'request_id': 'req-40fd9576-b660-4370-afd7-009cfc58635f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.411336 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5817b81c97f64b378c8a7ce7410e2913', 'request_id': 'req-40fd9576-b660-4370-afd7-009cfc58635f'} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.424010 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] The token cache is being invalidate because project 5817b81c97f64b378c8a7ce7410e2913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81564) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:07:42.424335 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.425008 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG keystone.notifications [None req-40fd9576-b660-4370-afd7-009cfc58635f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81564) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:07:42.426513 dv-cinder-854274-5-smb devstack@keystone.service[81564]: [pid: 81564|app: 0|req: 1440/2934] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Sep 13 20:07:42 2022] DELETE /identity/v3/projects/5817b81c97f64b378c8a7ce7410e2913 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:07:52.083437 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:52.419300 dv-cinder-854274-5-smb devstack@keystone.service[81564]: DEBUG dbcounter [-] [81564] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81564) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:14.835508 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Authenticating user token {{(pid=81563) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:14.837083 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:14.911452 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee075-8199-4cd9-90b7-43bd168dd924 admin admin] Validating token access rules against request {{(pid=81563) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:14.977862 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afb56a729d814fefaf904697e97fd33c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a92ea0034db4d81aec7850955d18e5e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81563) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:14.978486 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] REQUEST_METHOD: `GET` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:14.978766 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] SCRIPT_NAME: `/identity` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:14.979062 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81563) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:14.981008 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.fernet_utils [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81563) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:14.992693 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:14.994292 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd8022-b049-4d1d-84e3-25bfe3a9954f service placement] RBAC: Authorization granted {{(pid=81563) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:15.004908 dv-cinder-854274-5-smb devstack@keystone.service[81563]: [pid: 81563|app: 0|req: 1495/2935] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:25.000651 dv-cinder-854274-5-smb devstack@keystone.service[81563]: DEBUG dbcounter [-] [81563] Writing DB stats keystone:SELECT=58 {{(pid=81563) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}